CERO: Where and When to Allocate Rollouts for RL Post-Training
Adaptive rollout methods for group-relative reinforcement learning typically allocate a fixed per-update budget across prompts. We instead study how to coordinate a finite rollout budget over the entire training horizon. We formulate this problem using a concave surrogate utility of cumulative prompt exposure and intro...
Yi-Ming Zong, Yi-Ge Wang, Xin-Ting Hu et al.
· 0 citations