Reinforcement learning with verifiable rewards (RLVR) has substantially improved the mathematical reasoning capabilities of large language models. Recent work introduces search into RLVR rollouts to increase trajectory diversity, but diversity alone does not ensure that the search-induced rollout policy improves upon t...
Shao-Huai Liu, Yu-Ning Wu, Hao Liu et al.· 0 citations
HAPO improves the average accuracy of three major mixed-policy methods while maintaining training stability, and can be layered on top of existing mixed-policy methods in a generalizable manner.
In this work, we present ZGCM-1, a fully open 7B dense foundation model trained from scratch with extreme data, system, and algorithmic efficiency. ZGCM-1 is founded on a core premise: compact models cannot passively memorize the open web, but can overcome parametric capacity limits by coupling deliberate internal thin...
Ji-Yan He, Guang Liang, Hao Liu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.