Li Li

HeimdaLLM: Efficient Cloud-assisted Federated Fine-tuning with Zeroth-Order Rectification for LLMs

HeimdaLLM is a cloud-assisted federated fine-tuning framework that combines ZOO with Gradient Rectification (ZGR) and reduces memory footprint for client devices, achieves up to 8.8× faster convergence than the baselines, and improves accuracy by up to 10% over state-of-the-art ZOO methods.