Rubric-based reinforcement learning (RL) evaluates responses against explicit criteria to construct rewards, offering a viable way to train large language models on open-ended tasks. However, standard methods compress criterion-level feedback into scalar rewards and assign uniform token advantages, leaving structured r...
Guang-Cheng Zhu, Ying-Fan Ma, Xing Zheng et al.· 0 citations
Criterion-Distilled Policy Optimization (CriPO), which enhances rubric-based RL via on-policy self-distillation via on-policy self-distillation, to simultaneously address both unexplored and suppressed criteria.
Mingxuan Xia, Yuhang Yang, Chaonan Ye et al.· arXiv.org· 3 citations· ⚡2
DE-Venus is presented, a unified framework for data-efficient RLVR that treats supervision as evolving state across data preparation and policy optimization and reduces annotation and training costs without sacrificing scalable RL execution.
Shen-Zhi Yang, Guang-Cheng Zhu, Kai Tang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.