Quality Determines Direction, Length Shapes Magnitude: Length Control for Open-Ended Reinforcement Learning
Quality-Gated Length Advantage Shaping (QGLAS), which first computes advantages from quality rewards alone, then adds bounded bonuses only to shorter positive-advantage responses, leaving all other advantages unchanged, consistently achieves a stronger quality--length trade-off than representative baselines.
Zi-Jun Weng, Zhong-An Bi, Xuan-Ang Gao et al.
· 0 citations