Lisa Alazraki

Repetition Mismatch: Why Data Mixture Experiments Don't Scale and How to Fix Them

The results reveal that repetition dynamics, not scale alone, shape whether small-scale mixture experiments generalize, and suggest that data repetition deserves treatment as a first-class variable in mixture optimization, rather than an inconvenient side effect of limited data.