Mitigating the Length-Scaling Tax with Online Distillation
Length scaling during reinforcement-learning (RL) post-training is often viewed as a sign of improved reasoning ability, especially on difficult problems, but may also make responses to already-solved problems unnecessarily verbose. We quantify this side effect as the length-scaling tax (LST): excess response length on...
Xu Wan, Wen-Yue Xu, Sheng-Jie Zhao et al.
· 0 citations