Preprint
Jul 2026
PPL-Factory: Task-Aware and Budget-Aware Data Selection from Language Modeling to Reasoning
PPL-Factory is proposed, a simple and interpretable data selection framework that combines task-aware perplexity-based scores and data budget-aware selection criteria that outperforms other state-of-the-art data selection methods using only $1\%$ of the training set.
Hang Zhang, Warren J. Gross
· 0 citations