Skip to content

Author

Jian-Hao Yan

We have 4 of 14 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

TPPO: Tracking-Value PPO For Language Model Reasoning

Proximal Policy Optimization (PPO) is widely used in reinforcement learning with verifiable rewards for language-model reasoning. While \emph{value evolution along trajectory} characterizes relative token-level credit, yet standard critics often fail to track it under sparse terminal rewards. To model this evolution, w...

Fu-Ting Wang, Chen-Xi Li, Jian-Hao Yan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Gains and Collapse in On-Policy Distillation:A Reinforcement Learning Perspective

On-policy distillation (OPD) has become an important approach to language model post-training. However, despite its performance gains, OPD can also collapse into excessively long and repetitive generation, and the mechanism underlying these divergent outcomes remains poorly understood. We explain these outcomes through...

Han Cui, Jian-Hao Yan, Yun Luo et al. · 1 citation

DeepInstructor: An Agentic AI Instructor for Experience-Driven Idea Evaluation

This work proposes DeepInstructor, an agentic framework that formulates idea evaluation as reasoning over structured scholarly experience, and introduces DeepInstruct, a dataset with controlled pairwise comparisons across novelty, significance, and feasibility.

Rong-Can Pei, Fang Guo, Qing-Lin Qi et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Rethinking Critic Learning in PPO: Understanding and Mitigating Value Flattening

Value Flattening is identified as an important yet overlooked failure mode of critic learning in standard PPO and a simple sparse supervision strategy can mitigate it; SParse Proximal Policy Optimization is introduced, which applies the value loss to only a few well-separated states in each response to mitigate both ef...

Yi-Zhuo Li, Jian-Hao Yan, Yun Luo et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.