Teacher Should Think Ahead: Adaptive Continuations for Reliable On-Policy Distillation
On-policy distillation (OPD) is a promising approach for transferring knowledge between language models, where a student receives dense token-level supervision along its own generated trajectories. However, teacher supervision can be unreliable when conditioned on incomplete or low-quality student prefixes. We identify...
Jin-Gang Zhou, Yu-Yi Zhou, Hai-Yang Guo et al.
· 1 citation