2025 : 11 : 5
abbas ramezani

abbas ramezani

Academic rank: Assistant Professor
ORCID:
Education: PhD.
ScopusId:
HIndex:
Faculty: Faculty of Engineering
Address:
Phone:

Research

Title
ResFed: An Accurate and Light Federated Multi-Shot Pre-Trained Model on Edge Devices
Type
JournalPaper
Keywords
Federated Learning (FL); meta-learning; deep learning; few-shot federated classification.
Year
2025
Journal Tsinghua Science and Technology
DOI
Researchers ، Mahdi Abbasi ، abbas ramezani ، Amir Taherkordi ، Mohammad Reza Khosravi

Abstract

The rise of machine learning applications at the network edge demands real-time prediction with limited resources, requiring low computational complexity and accurate models. Also, these devices may have poor learning ability due to the lack of samples. Using federated learning enables devices to train machine learning models without sharing their private data. Meta-learning algorithms, particularly few-shot learning, are ideal for federated environments with highly personalized and decentralized training data due to their fast adaptation and good generalization to new tasks. Despite recent advances, the use of metric-based metalearning methods remains ambiguous due to their simplicity, as well as their development to improve model learning ability and accuracy in a federated environment. This paper introduces ResFed, a federated metalearning method specifically tailored for few-shot classification. The approach involves leveraging a pre-trained model and implementing data augmentation within the federated meta-learner, leading to favorable performance outcomes. The experimental results show that our approach, specifically designed for limited data scenarios in the federated environments, significantly improves convergence speed and accuracy. The values of accuracy obtained in CIFAR-100 and Omniglot datasets are 77.44% and 98.24%, respectively. Additionally, when compared to alternative methods, there is a notable reduction in resource costs ranging from 0.4 to 0.61 in diverse scenarios.