STOP (Structured On-policy Pruning), an on-policy algorithm for analyzing and pruning long-form reasoning traces, which improves the structural efficiency of generated reasoning, and reallocates reasoning effort away from redundant verification and backtracking toward more productive exploration.
Chenjun Xu, Zhen-Nan Zhou, Zhan Su et al.· arXiv.org· 0 citations
Search-on-Graph-R1 (\sogrone{}), which internalizes this navigation into a compact 8B model through supervised fine-tuning (SFT) followed by reinforcement learning (RL), which surpasses every frozen frontier-LLM system in their comparison and posts the strongest results on CWQ of any system the authors compare against.
J. Sun, Hao Yu, Fengran Mo et al.· arXiv.org· 1 citation· ⚡1
This work proposes TAPO: Transition-Aware Policy Optimization for LLM Agents, a unified training framework that alternates between policy optimization and transition supervision, and demonstrates that TAPO consistently improves task performance over pure policy optimization baselines.