TurnWise is proposed, a turn-level GRPO framework that aligns learning with individual streaming decisions and addresses the mismatch between trajectory-level feedback and turn-level interaction, promoting informative responses and reducing redundancy in streaming video understanding.
Shuai Dong, Kang-Hui Tian, Ling-Han Chen et al.· 0 citations
The results support OPD as preparation for RL and favor forward KL when OPD is followed by RL in the authors' comparison, which highlights the importance of both objective choice and the states receiving supervision for subsequent RL.
It is found that effective warm-up relies on teacher-compatible chain-of-thought supervision, and that even incorrect teacher rollouts can provide comparable benefits to correct ones, which suggests that warm-up primarily transfers a teacher-compatible thinking pattern rather than merely correct answers.
Tao Liu, Taiqiang Wu, Mao Zheng et al.· 3 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.