HeimdaLLM: Efficient Cloud-assisted Federated Fine-tuning with Zeroth-Order Rectification for LLMs
Large Language Models (LLMs) have achieved remarkable success in NLP tasks, but fine-tuning them on resource-constrained mobile devices remains challenging due to prohibitive memory and computation requirements. Federated Learning (FL) enables privacy-preserving distributed fine-tuning, yet conventional approaches, inc...