Preprint
Aug 2026
Adaptive Supervised Anchoring for On-Policy Self-Distillation
Context quality is identified as a central bottleneck in on-policy self-distillation and the value of separating rollout-conditioned guidance from canonical supervision is demonstrated, demonstrating the value of separating rollout-conditioned guidance from canonical supervision.
Meilin Yang, Zixuan Ding, Jianhao Nie et al.
· 0 citations