Reward-Free Policy Optimization (RFPO), which repurposes a single calibrated, frozen critic as a rollout-level reward, a value baseline for generalized advantage estimation, and a success forecaster for unfinished prefixes is introduced.
Hong-Yang Li, Xiao Li, Caesar Wu et al.· 0 citations
These stages establish a constructive post-training path from English-pivoted capability to multilingual reasoning that is reliably delivered, and jointly track correctness, language adherence, termination, and delivery efficiency.
Hong-Yang Li, Xiao Li, Caesar Wu et al.· 0 citations
Post-training is central to mathematical reasoning in modern large language models (LLMs), but endpoint pass@1 alone underidentifies what has changed. Gains may reflect newly reachable solutions, cheaper sampling of latent solutions, surface robustness, or memorisation. We compare three post-training paths under a comm...
Hong-Yang Li, Yi-Ming Zhu, Xiao Li et al.· 0 citations
On-policy distillation, where a student learns from a stronger teacher's feedback on its own outputs, is a common way to pass reasoning to smaller models. We analyze what it transfers at small scale, distilling Qwen3-8B into Qwen3 4B, 1.7B and 0.6B students, in thinking mode (reason at length, then end the reasoning an...
Hong-Yang Li, Yi-Ming Zhu, Xiao Li et al.· 1 citation
LLM-based Multi-Agent Systems (MAS) achieve strong performance on complex reasoning tasks by coordinating multiple agents, but at the cost of substantial token consumption. Recent work on automatic topology design, ARG-Designer, has reframed this problem as autoregressive graph generation. However, its training objecti...
Poomphob Suwannapichat, B. Changaival, Caesar Wu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.