Preprint
Oct 2026
Asynchronous On-Policy Self-Distillation
This work introduces Asynchronous On-Policy Self-Distillation (AsyncOPSD), a framework that decouples rollout generation from learner updates to improve training throughput and introduces a distillation objective based on staleness-aware policy control and token-level entropy weighting.
Xi-Dong Wu, Qi Qi, Yu-Qiong Ji et al.
· 0 citations