DomainPilot: Domain-Level Loss-Guided Two-Stage Data Mixture Optimization for Efficient Language Model Fine-Tuning
DomainPilot introduces token-level domain loss monitoring to capture per-domain learning dynamics during training without halting the data pipeline, and demonstrates that domain-level training signals provide an effective, lightweight alternative to expensive data selection or auxiliary model training for mixture optim...