i-FedLoRA provides privacy guarantees, improves model accuracy by up to 3.8%, and expedites training by 1.37-2.23×, and facilitates heterogeneous LoRA aggregation that selectively prioritizes high-confidence knowledge to filter DP-induced noise, thereby achieving robust knowledge transfer.
Nan Yan, Yuqing Li, Xiong Wang et al.· Proceedings of the 32nd ACM...· 0 citations
iFLoRA is proposed, an improved Federated LoRA fine-tuning system for LLMs featuring pipelined error-mitigated model aggregation and adaptive matrix-wise parameter freezing and can improve time-to-target by 2.17-8.48 × than state-of-the-art methods.
Haoran Wang, Xiong Wang, Yuqing Li et al.· Annual Meeting of the Associ...· 1 citation