Preprint
Aug 2026
Close Shortcut Wins Long: Seeking Diverse and Stable Generators for Data-Free Knowledge Distillation
Data-Free Knowledge Distillation (DFKD) preserves privacy by transferring knowledge without real data access. However, existing generator-based DFKD methods suffer from over-reliance on teacher preferences and pattern collapse, exhibiting"generative shortcut learning"in the frequency domain: dependent on specific frequ...
Kailin Lyu, Zherui Zhang, Jun-Hao Dong et al.
· 0 citations