#artificial intelligence
May 2026
Repetition Mismatch: Why Data Mixture Experiments Don't Scale and How to Fix Them
The results reveal that repetition dynamics, not scale alone, shape whether small-scale mixture experiments generalize, and suggest that data repetition deserves treatment as a first-class variable in mixture optimization, rather than an inconvenient side effect of limited data.
Kevin S. Zhou, Lisa Alazraki, Kris Cao et al.
· arXiv.org · 2 citations