Book
Open access
Aug 2026
HeimdaLLM: Efficient Cloud-assisted Federated Fine-tuning with Zeroth-Order Rectification for LLMs
HeimdaLLM is a cloud-assisted federated fine-tuning framework that combines ZOO with Gradient Rectification (ZGR) and reduces memory footprint for client devices, achieves up to 8.8× faster convergence than the baselines, and improves accuracy by up to 10% over state-of-the-art ZOO methods.
He Sun, Jinrui Zhou, Li Li et al.
· Proceedings of the 32nd ACM... · 0 citations