Not Every Rollout Needs Distillation: Correctness-Filtered On-Policy Self-Distillation
On-policy self-distillation (OPSD) supervises student-generated trajectories with a reference-conditioned version of the same base model. We ask whether every trajectory supplies distinct supervision that warrants its distillation cost. Gradient measurements on Qwen3-1.7B at initialization reveal that correct and incor...
Harrison Zhao, Lei Huang, Zhi-Yuan Zhao et al.
· 0 citations