Mitigating the Length-Scaling Tax with Online Distillation
LSD is proposed, which routes solved prompts to on-policy distillation and retains the original RL objective for unsolved prompts and achieves comparable or better performance than RL across multiple variants, while substantially curbing response-length growth on easy queries.
Xu Wan, Wen-Yue Xu, Sheng-Jie Zhao et al.
· 0 citations