RoVR-GSPO is introduced, a dual-channel robust optimizer that addresses group-relative policy optimization failure modes separately and shows consistent improvements over GSPO, while controlled perturbation studies demonstrate stronger robustness to reward contamination and token-ratio anomalies.
Zhong-Yi Li, Wan Tian, Xiang Xu et al.· 0 citations
Reward hacking occurs when policy optimization exploits a brittle reward interface or an overly permissive proxy objective, improving the training score without improving the underlying response quality. This phenomenon is amplified in group-relative policy optimization: an unsupported reward can shift the group baseli...
Wan Tian, Zhong-Yi Li, Xiang Xu et al.· 0 citations
Mixed human-LLM documents require locating authorship transitions from detector scores whose reliability varies across text units. Existing weighted mean contrasts are vulnerable to extreme scores, while directly replacing means with robust centers obscures how a misplaced boundary changes the population objective. We...
Wan Tian, Zhong-Yi Li, Ya-Wen Li et al.· 0 citations
Artificial intelligence (AI) is a double-edged sword: while it has achieved remarkable success across a wide range of domains, its deployment also calls for effective oversight and regulation, for which the detection of AI-related content and artifacts is perhaps the most direct and cost-effective approach. To this end...
Xifeng Zhang, Tao Hu, Yijie Peng et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.