HO-FL: Hybrid-Order Federated Learning for Heterogeneous Edge Devices
HO-FL is introduced, a hybrid-order FL framework that trains a model's bottom segment with ZO optimization and its top segment with FO optimization, and shows that hybrid-order local training can retain much of the full-FO performance with substantially lower client memory requirements.