Jiangchao Yao

Towards Understanding On-Policy Distillation through the Lens of Test-Time Scaling

It is observed that OPD-trained models maintain superior avg@K performance across sampling budgets, while the advantage in pass@K gradually shifts to the pre-OPD base models as K increases, suggesting that OPD primarily improves sampling efficiency rather than consistently expanding the student's reasoning capability b...