Sep 2026· Applied and Computational Engineering· 0 citations
Privacy-Preserving Technologies in Data
TL;DR
This paper proposes a selection strategy according to data heterogeneity, bandwidth and system constraints, and recommends the unified reporting of accuracy, communication volume, communication rounds, time, and energy consumption.
Abstract
As data in scenarios such as medical, transportation and the Internet of Things continue to be dispersed to institutions and edge devices, how to balance the quality of model training and communication costs without concentrating raw data has become an important issue in the deployment of federated learning. Federated learning faces a coupling bottleneck between client drift and communication overhead under non-independent and non-identically distributed (Non-IID) data. This paper reviews aggregation, compression and hybrid strategies with representative studies, and verifies Federated Averaging (FedAvg), Federated Proximal (FedProx) and their error-feedback Top-k combinations (FedAvg+EF-Top-k and FedProx+EF-Top-k) under the unified setting of Fashion-MNIST. The results show that compression can significantly reduce the cumulative uplink communication required to reach the target accuracy and enable more training rounds under a fixed total communication budget. However, strong heterogeneity is associated with greater run-to-run variability, and communication rounds, transmitted bits, and end-to-end time cannot be substituted for one another. Based on literature comparison and verification results, this paper proposes a selection strategy according to data heterogeneity, bandwidth and system constraints, and recommends the unified reporting of accuracy, communication volume, communication rounds, time, and energy consumption.
An asynchronous framework named FedQS, which employs a multi-dimensional staleness evaluation mechanism that dynamically assesses updates by combining the similarity between local and global models with client latency metrics, and implements a decoupling solution via a queue scheduling algorithm to resolve the coupling...
Jia-Hui Zhou, Fang Li, Tian-Yu Shi et al.· Journal of Cloud Computing· 0 citations
A new approach, FedLR, is proposed in this manuscript to remedy the problem of slacker devices, which provides all the benefits of FedAvg while reducing the communication costs between the devices.
Decentralized Machine Learning (ML) through Federated Learning (FL) offers an alternative to centralized machine learning while preserving privacy for handover prediction, but client data distributions in networks such as fifth-generation (5G) are non-Independent and Identically Distributed (non-IID), which influences...
Federated learning (FL) is a promising paradigm of machine learning, which preserves user privacy by enabling learning without sharing raw data with a cloud server. Straggling clients have been a problem for FL as they introduce delays in aggregating the local models and hence, the convergence of the global model. Ther...
The growing volume of data from smart devices offers significant potential for machine learning, yet privacy concerns hinder centralized use. Federated Learning (FL) has emerged as a promising decentralized learning (DL) approach enabling the use of distributed data without compromising privacy. However, practical depl...
Zahid Iqbal, Fatima N. al-Aswadi, Haziqah Shamsudin et al.· IEEE Access· 2 citations
Federated learning (FL) offers an appealing way to train models across distributed devices without centralizing raw data, but deploying it in large, real-world networks quickly reveals serious limitations. Communication bottlenecks, unreliable connections, and the risk of a single aggregation server becoming a point of...
Aayush Srivastava, Prince Kumar, Arijit Roy· IEEE International Symposium...· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduNov 17, 2026
By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.
MIT News · Artificial Intelligence· news.mit.eduNov 17, 2026
AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduNov 9, 2026