Data Density Scaling Laws for Image Self-Distillation
This work proposes a modified version of a Chinchilla-style scaling law that explicitly accounts for two factors: the number of unique samples and repetition per sample, which provides a framework for understanding data-compute trade-offs and improves prediction in some regimes where repetition plays a central role.