Preprint
Aug 2026
Step-Level On-Policy Distillation: Interpolating Between On-Policy Distillation and Supervised Fine-Tuning
Step-Level On-Policy Distillation is proposed, which combines the long-horizon correction of supervised fine-tuning (SFT) with the on-policy advantage of OPD to provide step-level supervision over complete student-generated trajectories and substantially outperforms conventional SFT and OPD.
Changhui Sun, Lan-Bo Liu, Hang Lei et al.
· 2 citations