Timestep Weighting: A Hidden Key to Effective ELBO-Based Flow-Matching RL
This work investigates impacts and dynamics of timestep weighting in ELBO-based RL, and establishes timestep weighting as an important design choice for flow-matching RL and motivates further research into methods that choose and adapt it throughout learning.