Author

Chao Qu

h-index 2 View on Semantic Scholar

We have 2 of 4 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

COPC: Coupled Off-Policy Correction for Asynchronous LLM Reinforcement Learning

COPC is introduced, an actor--critic method combining token-level ratio masking with two-sided clipped-ratio weighting of TD residuals for return and advantage estimation that achieves the highest reported performance on tool-integrated mathematical reasoning and search, outperforming the strongest reported asynchronou...

Zi-Cheng Hu, Zhi-Jian Zhou, Xuan Zhang et al. · 0 citations

Preprint Aug 2026

Start Classifying: Categorical Critics for LLM Reinforcement Learning

Proximal Policy Optimization (PPO) for large language models typically trains its critic by mean-squared-error (MSE) regression on scalar value targets. Although scalar MSE is statistically valid for estimating the conditional expected return, sparse binary rewards in reinforcement learning with verifiable rewards (RLV...

Zhi-Jian Zhou, Long Li, Xuan Zhang et al. · 2 citations · ⚡2