Preprint
Aug 2026
Towards Understanding On-Policy Distillation through the Lens of Test-Time Scaling
It is observed that OPD-trained models maintain superior avg@K performance across sampling budgets, while the advantage in pass@K gradually shifts to the pre-OPD base models as K increases, suggesting that OPD primarily improves sampling efficiency rather than consistently expanding the student's reasoning capability b...
Xinmu Ge, Zi-Zhuo Zhang, Yu Huang et al.
· 5 citations
· ⚡1