Jian-Ping Gou

Federated Distillation: A Survey

Federated learning (FL) enables collaborative model training without centralizing clients’ raw data, but parameter exchange can impose substantial communication costs and usually requires compatible model architectures. Federated distillation (FD) instead transfers predictive or intermediate knowledge through knowledge...

Adaptive Decoupled Knowledge Distillation via Self-Learning

Stay Rational, Resist Illusions: De-biasing Source-Free Domain Adaptation with CLIP-Verified Pseudo-Source Domain

A novel Staying Rational and Resisting Illusions (SRRI) method for SFDA to resolve the two fundamental challenges: confirmation bias and domain shift, and innovatively leverage the CLIP (Contrastive Language-Image Pre-training) model as a source of external knowledge to mitigate feature confounding.