Close Shortcut Wins Long: Seeking Diverse and Stable Generators for Data-Free Knowledge Distillation
A CSWL framework aimed at introducing insights from the frequency domain perspective to improve generator diversity and training stability to Close the phenomenon of Shortcut learning to Win in the Longer term is proposed.