Skip to content

Communication-efficient heterogeneous federated learning for large language models: federated asymmetric adaptive LoRA fine-tuning

Sep 2026 · International Journal of Machine Learning and Cybernetics · Vol 17 · 0 citations · 46 references

TL;DR

The Federated Asymmetric Adaptive LoRA method reduces trainable parameters by nearly half compared with standard AdaLoRA, while incurring only a marginal performance degradation, and introduces the Federated Adaptive Budget Strategy to enhance the effectiveness of federated learning.

View source

Similar papers

MEPO-SLM: multi-objective evolutionary prompt optimization for energy-efficient small language models on edge devices

MEPO-SLM is presented, a framework that reformulates prompt engineering for SLMs as a four-objective Pareto problem over task inaccuracy, and Phi-3-mini and Gemma-2B on English TriviaQA and Arabic medical QA, and TinyLlama-1.1B on TriviaQA only are evaluated.

Yousef K. Sanjalawe, Salam R. Al-E'mari, S. Makhadmeh · 0 citations
Open access Aug 2026

Tuning Social Indexes on Training-Data

To help a (perhaps artificial) policy decider compare the performance of its (perhaps artificial) social agents, a type of abstract evaluation machine is presented that could be used in various concrete operative situations. Designed on a sequence of progressively more challenging objectives on the chain \documentclass...

G. D'Epifanio · 0 citations

Explainable Federated Learning for Trustworthy Thoracic Disease Detection Under Non-IID Data Distributions

Comparison of SHAP and Grad-CAM attribution maps confirms clinically coherent disease-specific localisation, and reveals monotonic performance degradation, identifying minimal regularisation as optimal for multi-label medical imaging.

S. Arumugam, A. Sindhu, M. N. Saroja et al. · 0 citations
Sep 2026

Fast Algorithms for a Large-Scale File Aggregation Problem

Results show that OnGP provides a robust online solution with efficiencies close to the Best Fit algorithm, while OffGP matches the near-optimal performance of Best Fit Decreasing within a 1.036% margin, confirming their value for time-critical applications.

Li-Feng Guo, Chang-Hong Lu, Qing-Jie Ye · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.