Reinforcement fine-tuning (RFT) is increasingly used in applications where large language models (LLMs) interact with humans and other agents. Here we use social deduction games to study how RFT changes LLMs'social behaviour. We let fine-tuned and base LLM agents play hidden-role games that require hidden-state inferen...
Ling-Zhe Zhang, Yun-Peng Zhai, Tong Jia et al.· 0 citations
This work introduces EAVer, an End-to-end Agentic Verifier that learns to control the complete response-level verification workflow as a unified policy, and construct 794 bidirectional same-trajectory preference pairs that keep claim grouping, search, and evidence fixed, enabling decision-focused Direct Preference Opti...
Ke-Ning Zheng, Ao-Ying Zheng, Zhi-Gang Chang et al.· 0 citations
Reinforcement learning (RL) post-training drives the frontier capabilities of large language models, with its wall-clock dominated by autoregressive rollout generation. Speculative decoding is an established remedy for this bottleneck, but existing draft heads must be pretrained or warmed up before RL, introducing subs...
Ming-Hua He, Ling-Zhe Zhang, Yuan Liu et al.· 0 citations
This work proposes RLCSD (Reinforcement Learning with Contrastive on-policy Self-Distillation), which mitigates this drift by contrasting the teacher-student gap under a correct hint against that under a wrong hint, suppressing style shifts induced by hints regardless of correctness and yielding a signal more concentra...