TurnWise is proposed, a turn-level GRPO framework that aligns learning with individual streaming decisions and addresses the mismatch between trajectory-level feedback and turn-level interaction, promoting informative responses and reducing redundancy in streaming video understanding.
Shuai Dong, Kang-Hui Tian, Ling-Han Chen et al.· 0 citations
Rule-governed contextual decision tasks require models to apply specified rules to case-specific context and evidence. Written rules can leave gaps in decision guidance and process evaluation, while reference judgments vary in their support from the rules and evidence. To address these challenges, we introduce AdaptEvo...
Shi-Jun Wan, Jian-Cong Xie, Han-Rui Xu et al.· 0 citations
Language model agents are increasingly deployed in open-world tool environments, which require balancing exploring unknown capabilities and exploiting known ones. Existing methods face a performance-efficiency tradeoff: they either rigidly decouple exploration and execution or interleave them without coordination. We a...
Shengbin Yue, Hongru Wang, Siyuan Wang et al.· arXiv.org· 1 citation
The results support OPD as preparation for RL and favor forward KL when OPD is followed by RL in the authors' comparison, which highlights the importance of both objective choice and the states receiving supervision for subsequent RL.