Soeun Kim

Diversifying RLVR Rollouts via First-Token Exploration

This work identifies the first token of the response as a structurally distinct target for diversification, largely overlooked in prior work, and finds that the first-token distribution is sharply concentrated and only weakly related to downstream correctness, as lower-probability candidates can yield similarly accurat...