FedTopo is proposed, a relation-level framework that encodes global knowledge as class relation topology, capturing how classes relate within each client rather than where they lie in feature space.
Abstract
Federated learning (FL) enables collaborative learning over decentralized data silos without centralizing raw data. However, heterogeneous local architectures often induce non-aligned representation spaces, making it difficult to transfer global knowledge across silos. Existing paradigms share this knowledge as model parameters, distilled predictions, or class prototypes, yet all encode it in an absolute space that must be aligned across clients. Heterogeneous backbones break this alignment, so the shared knowledge becomes unreliable and misleads local training. We propose FedTopo, a relation-level framework that encodes global knowledge as class relation topology, capturing how classes relate within each client rather than where they lie in feature space. Each client builds its relation topology from local prototypes and uploads it with class statistics. The server then aggregates these relations in a reliability-aware manner that down-weights weakly supported ones, and broadcasts the global topology to clients. The global topology guides local training by emphasizing topology-similar negative classes. Experiments on three datasets under eight heterogeneous backbones show that FedTopo consistently outperforms parameter-, distillation-, and prototype-sharing baselines, with low communication and no inference overhead. Our code is available at https://github.com/Zhaoyang-Ma/FedTopo.
Prototype-based knowledge sharing effectively mitigates data and model heterogeneity in federated learning (FL) by exchanging class-level semantic information. However, existing methods typically assume all local prototypes are equally reliable. Consequently, low-quality prototypes from heterogeneous models or dynamic clients can contaminate the global aggregation, leading to a vicious cycle of noise accumulation and performance degradation. To address this, we propose FedLEAF, a Federated Learning framework with server-side proactive Evaluation and clientside Adaptive Fusion. Specifically, the server employs an Adaptive Learning Prototypes (ALP) network to dynamically evaluate prototype reliability and generate learnable aggregation weights, ensuring that highquality prototypes exert a primary influence on the global model. Meanwhile, the client utilizes a Historical Consistency Fusion (HCF) strategy to selectively absorb global knowledge by assessing its consistency with locally maintained historical prototypes. Extensive experiments on standard datasets demonstrate that FedLEAF achieves effective improvements in model accuracy and robustness compared to existing methods.
Zhiyuan Zhu, Si-Yi Deng, Dapeng Wu et al.· 2026 International Conferenc...· 0 citations
The heterogeneous nature has been regarded as a predominant challenge during the deployment of federated learning (FL) systems, wherein model heterogeneity—where clients train models of fundamentally different architectures—remains underexplored. Existing methods tolerate it poorly: they enforce interdependent model families, extract sub-models of one shared model, or rely on auxiliary public datasets and proxy models, which constrain model selection or demand storage that resource-limited clients cannot afford. We posit that an effective bridge across heterogeneous models should be both model-agnostic—decoupling knowledge transfer from incompatible parameter spaces—and storage-free, staying practical for clients with sharply different resources. On this basis we propose FedGPA, a hierarchical framework in which clients with comparable resources and identical architectures form a group and a server mediates knowledge transfer across groups of diverse models; at its core, the lightweight, model-agnostic Aligned Co-decision (Alco) Unit aligns class-level prototypical information across groups to bridge heterogeneous architectures, and a prototypical fusion step interpolates prototypes to regularize local training and refine cross-group knowledge. Experiments on CIFAR-10/100, EMNIST, and Tiny-ImageNet across heterogeneous architectures show that FedGPA consistently outperforms strong baselines from four method families, with the largest gains on resource-poor clients, at a cost of only ~100 KB of additional cross-group communication per round. A limitation of this study is that we provide no formal differential-privacy guarantee for the exchanged prototypes and do not address adversarial or data-quality attacks, leaving both to future work.
Liyinglan Liu, Zikai Xiao, Zihan Chen et al.· Journal of Machine Learning...· 0 citations
Federated learning (FL) collaboratively trains models across networked industrial Internet of Things (IIoT) terminals. However, statistical heterogeneity in IIoT data often hinders the performance of global models. Current FL methods typically focus on single-level representation alignment and fail to exploit gradient-guided semantic feedback across hierarchical layers. To address statistical heterogeneity, we propose federated hierarchical prototype learning (FedHiPL), which models local representations with Gaussian prototypes and improves global learning through hierarchical prototype calibration. First, FedHiPL performs multilevel prototype alignment based on symmetric Kullback–Leibler divergence to enforce representation consistency across layers. Second, FedHiPL calibrates the local decision head by balancing local and global decision objectives with decision consistency constraints. Third, FedHiPL rectifies global prototypes through a gradient-guided hierarchical calibration module to maintain structural consistency across network layers. Experiments on a custom-constructed distributed cluster demonstrate that FedHiPL achieves 93.24% accuracy on Edge-IIoT and 72.36% accuracy on UNSW-NB15 under strong statistical heterogeneity, outperforming the representative prototype-based baseline FedProto by 6.06% and 15.80%, respectively.
Fang Li, Zhi-Cheng Chen, Jinghao Liu et al.· IEEE Internet of Things Jour...· 0 citations
This work proposes a FedIGL framework based on invariant learning, which effectively disrupts spurious correlations and further mines the invariant factors across different distributions, and proposes a novel Bi-Gradient Regularization strategy that introduces gradient constraints to guide the model in identifying client-agnostic and client-specific subgraph patterns for better graph representations.
Lingren Wang, Wenxuan Tu, Jiaxin Wang et al.· Neural Information Processin...· 2 citations
Subgraph federated learning (subgraph FL) enables collaborative graph neural network training without sharing raw graph data, but suffers from severe Non-IID distributions and structural fragmentation. In such settings, Non-IID distributions induce pronounced client specialization, where each client excels in a subset of nodes but remains insufficiently trained on others. However, existing similarity-based aggregation and distillation methods fail to balance client specialization and global generalization, often reinforcing dominant local representations and impairing generalization on under-represented nodes, or over-incorporating global knowledge and thereby disrupting well-optimized local specialization. In this paper, we propose FedDUA, a novel disagreement-aware and uncertainty-guided framework for subgraph FL. Specifically, FedDUA first models cross-client semantic disagreement via a lightweight semantic anchor graph and derives adaptive aggregation weights for reliable global federated knowledge. On the client side, FedDUA introduces an uncertainty-aware local-global semantic alignment mechanism that selectively reinforces representations of confident nodes while guiding uncertain nodes with aggregated global knowledge, thereby balancing local specialization and global generalization. Extensive experiments on six real-world datasets demonstrate that FedDUA consistently outperforms the state-of-the-art subgraph FL methods across varying numbers of clients. Further analyses validate the robustness and effectiveness of the proposed disagreement modeling and uncertainty-aware local-global semantic alignment strategies.
Keao Xi, Nannan Wu, Yiming Zhao et al.· Proceedings of the 32nd ACM...· 0 citations