Federated Distillation: A Survey
Federated learning (FL) enables collaborative model training without centralizing clients’ raw data, but parameter exchange can impose substantial communication costs and usually requires compatible model architectures. Federated distillation (FD) instead transfers predictive or intermediate knowledge through knowledge...
Lin Li, Jian-Ping Gou, Bao-Sheng Yu et al.
· ACM Computing Surveys · 1 citation