Skip to content

Robust Decentralized Personalized Federated Learning via Prediction-Constrained Neighborhood Collaboration

Sep 2026 · 1 citation · 40 references
Computer Science

Abstract

This paper proposes a robust decentralized personalized federated learning method R-DPFL, that enables clients to reduce the impact of Byzantine attacks via robust neighborhood direction estimation and history-based update trend prediction, rather than purely aggregating client models as in the existing work. In R-DPFL, each client first computes the current-round model update by aggregating the received neighborhood update vectors. It then predicts what this update should be based on its historical values and local model changes. Finally, R-DPFL computes the difference between these two quantities, adaptively clips this difference, and adds it to the local update. We prove convergence of the learning process through rigorous analysis and show that honest clients maintain stable personalized descent dynamics under Byzantine neighbor perturbations without requiring consensus among neighboring models. Extensive experiments on CIFAR-10 demonstrate that RDPFL consistently outperforms state-of-the-art decentralized and personalized federated learning baselines under heterogeneous and adversarial settings.

View source

Similar papers

#machine learning Preprint Sep 2026

Similarity-Aware Personalized Federated Learning in Heterogeneous Environments

This work proposes SAPE-FL (Similarity-Aware Personalized Federated Learning), a novel personalization framework that anchors each client's model to both the global model and a similarity-weighted peer averaged model that mitigates negative transfer and enhances robustness in heterogeneous settings.

V. ArunKumarA, Sunil Gupta, Ngyuen Dang et al. · 0 citations
#machine learning Preprint Sep 2026

Robust Decentralized Federated Distillation via Multi-Modality Knowledge Collaboration

This paper shows that the proposed method ensures a bounded Byzantine influence on both distillation gradients and individual client private gradients after cross-modality fusion, thereby enabling stable local optimization for honest clients under Byzantine distillation.

Xiao Ma, Hong Shen, Hui Tian et al. · 0 citations
Book Open access Aug 2026

Taming Update Drift in Asynchronous Federated Learning via Orthogonal Calibration

Asynchronous federated learning improves the efficiency of conventional synchronous protocols by integrating updates as they arrive. However, asynchrony and data heterogeneity make learning objectives at global and local levels inherently inconsistent—global optimization trajectories can conflict with ongoing local upd...

Jiayun Zhang, Shuheng Li, Haiyu Huang et al. · 0 citations
Conference Open access Sep 2026

FedUP: Uncertainty-Aware Personalized Federated Learning via Probabilistic Prototypes

Prototype-based federated learning enables efficient knowledge sharing by exchanging class prototypes rather than full model parameters. However, heterogeneous client data and limited local samples increase prototype estimation variance, making many client prototypes unreliable. Existing methods usually treat prototype...

Fu Qi, Weishan Zhang, Ling-Zhao Meng et al. · 0 citations
Preprint Aug 2026

Beyond Parameter Space: NTK-Guided Personalized Aggregation for Robust Federated Learning

Local Inference Guided Aggregation for Heterogeneous Training Environments to Yield Enhancement Through Agreement and Regularization (LIGHTYEAR), a federated learning framework that performs update selection in function space using an NTK-based agreement score to characterize predictive behavior and determine a persona...

Mirko Konstantin, S. Zachow, Anirban Mukhopadhyay · 0 citations

Related blog posts

Microsoft Research Blog Sep 30, 2026

Forecasting space weather risks on power grids

Extreme space-weather events can damage power systems on Earth and degrade GPS accuracy and satellite operations. A new machine learning system can predict where damage is likely to occur 30-60 minutes before a storm arrives. The post Forecasting space weather risks on power grids appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.