TreeOPSD is introduced, a critic-free, tree-aware posterior self-distillation framework for long-horizon agentic reinforcement learning that improves agentic capabilities across several competitive benchmarks and model scales, especially for long-horizon tasks.
Heming Zou, Qi Wang, Yi-Xiu Mao et al.· 2 citations
This paper revisits the standard state-only formulation of value estimation and proposes PPO, a self-privileged actor-critic framework that consistently improves value-estimation quality by a substantial margin and outperforms representative actor-critic and critic-free RLVR baselines on challenging mathematical reason...
Kun Liang, Chenming Tang, Clive Bai et al.· 0 citations
Downstream RLHF experiments additionally show that using DRM as the training-time reward leads to improved policy performance, directly validating the practical benefit of diffusion-based reward modeling for RLHF training.
Xiang-Yang Wang, Bing-Xiang He, Ze-Yuan Liu et al.· arXiv.org· 0 citations
StudyBench is introduced, a controlled physics benchmark that directly measures how efficiently a self-evolution method converts training material into capability, and turns self-evolution progress from an open-ended pursuit into a measurable target for future research.
Ying-Hao Chen, Zi-Xi Chen, Bingxiang He et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.