Preprint
Jul 2026
When Data Imbalance Helps: Robust Generalization Through Shortcut Saturation
Through mechanistic analysis, a mechanistic pathway consistent with imbalance promoting generalization is characterized: a mechanistic pathway consistent with imbalance promoting generalization in sufficiently capable models.
Cheng-Ting Chou, Duc Hoang
· 0 citations