Aug 2026· Italian National Conference on Sensors· 0 citations· 21 references
TL;DR
FedMCP++, a modular and communication-efficient personalized FL framework in which every client owns a complete private model—a lightweight convolutional backbone with a private expert head—and collaboration is carried out entirely through knowledge exchange rather than parameter exchange, is introduced.
Abstract
Federated learning (FL) enables collaborative model training across decentralized clients while preserving data privacy, yet real-world deployments still face communication bottlenecks, performance degradation under heterogeneous client data, and limited personalization. In this study, we introduce FedMCP++, a modular and communication-efficient personalized FL framework in which every client owns a complete private model—a lightweight convolutional backbone with a private expert head—and collaboration is carried out entirely through knowledge exchange rather than parameter exchange. In each round, clients share only temperature-softened class predictions and class-wise feature prototypes computed on a small public proxy set; the server fuses them into an accuracy-weighted teacher and broadcasts the result, and clients realign their models through knowledge distillation, an instance-level contrastive objective, and prototype alignment. We evaluate FedMCP++, its ablations, and two knowledge-based baselines on six benchmark vision datasets with 10, 20, and 30 clients. The results indicate dataset-dependent trade-offs rather than uniform superiority: collaborative distillation improves average client-level accuracy over independent local training in twelve of eighteen configurations—most clearly under severe per-client data scarcity (e.g., up to +2.7 percentage points on KMNIST and +2.4 on STL-10 with 20–30 clients)—whereas independent training ensembles remain strongest on SVHN and CIFAR-10 at the studied budgets. Because no parameters are transmitted, the per-round uplink payload is a fixed-size 42.6 KB message, 9.9–12.8× smaller than full-model synchronization, and is invariant to model capacity. These properties make FedMCP++ a flexible framework for personalized FL in wireless edge and Internet of Things environments where bandwidth and privacy constraints are paramount.
Experimental results show that FedOPAL not only significantly outperforms the original analytical methods on several benchmarks, but also achieves accuracy comparable to state-of-the-art iterative methods while maintaining zero server-side training costs, providing a new engineering paradigm for efficient collaboration of large models on the edge.
Lingyu Qiu, Daniela Annunziata, Stefano Izzo et al.· 2026 2nd International Confe...· 0 citations
Experimental results on three datasets demonstrate that FedLIM achieves superior global model accuracy compared to existing one-shot FL methods, particularly in highly heterogeneous environments.
Yexin Dou, Haijiang Wang, Jian Wan et al.· IEEE Internet of Things Jour...· 0 citations
One-shot federated learning (OSFL) has emerged as a promising collaborative model learning framework with only a single round of communication, offering significant advantages in communication efficiency and privacy preservation. However, OSFL often faces inherent limitations under severe domain heterogeneity across clients due to the lack of iterative knowledge exchange. Most existing OSFL methods require an auxiliary public dataset for knowledge distillation or leverage statistical information for parameter-level aggregation, overlooking feature shift caused by domain heterogeneity. To address these challenges, we propose CRIP, a personalized OSFL framework that operates in the representation space via channel-level feature alignment. To achieve this, each client uploads its feature extractor to the server, which broadcasts all extractors back to every client. Since not all source clients share compatible feature distributions with the target client, indiscriminate fusion of cross-client features would introduce domain-specific noise. Therefore, CRIP effectively measures the channel-wise representational similarity between the target client and each source client on a small local mini-batch, and selectively fuses only the most compatible features. Extensive experiments on domain-heterogeneous benchmarks such as DomainNet, PACS, and Office-Home demonstrate that CRIP consistently outperforms local models and state-of-the-art baselines, validating the effectiveness of representation-space personalization under extreme domain heterogeneity.
Zijian Jiang, Chaoli Sun, Handing Wang et al.· 0 citations
Federated learning (FL) enables collaborative model training over distributed clients without sharing raw data, but its performance can degrade severely under non‐independent and non ‐ identically distributed (non‐IID) client data. To address this challenge, we propose
BiFCL
, a
Bi‐Level Federated Contrastive Learning
framework that improves global representation alignment through a lightweight server‐side auxiliary model trained on a small public dataset. BiFCL enforces bidirectional semantic consistency: on the client side, each local model is regularized by contrastively aligning its representations to the auxiliary model; on the server side, the auxiliary model is further updated via contrastive alignment with the evolving global model, preventing stale guidance and forming a closed‐loop regularization mechanism. We provide convergence guarantees for BiFCL under standard smooth non‐convex assumptions. Extensive experiments on five benchmarks (MNIST, EMNIST, SVHN, CIFAR‐10 and CIFAR‐100) demonstrate that BiFCL consistently outperforms strong FL baselines in both final accuracy and convergence speed. Overall, BiFCL provides an effective representation‐alignment strategy for heterogeneous federated learning when a small, diverse, and semantically relevant public, proxy or privacy‐preserving synthetic auxiliary source is available. We also discuss practical auxiliary‐data construction strategies, normalized communication cost and limitations under severe auxiliary‐domain mismatch and larger‐client deployments.
Shiqiang Zhang, Yang Cao, Yongli Yang· Expert systems· 0 citations
What if pathology foundation models could do more with less? GigaPath-Flash and GigaTIME-Flash cut computational demands while maintaining strong performance, opening the door to larger studies and broader exploration. The post GigaPath-Flash and GigaTIME-Flash: Toward population-scale discovery with efficient pathology foundation models appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduAug 31, 2026
With millions of users across the world, Julia has been used to conduct cutting-edge research and to design new drugs, jet engines, heat pumps, and more.
MIT News · Artificial Intelligence· news.mit.eduAug 27, 2026
A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.