Reinforcement learning with a verifiable reward (RLVR) offers a scalable approach to training language-model agents, yet sparse outcome rewards can leave early training with little signal for policy improvement. We identify an On-Policy Acceleration Phenomenon: in our main comparisons, RLVR initialized with on-policy d...
Yi-Tong Qiao, Tian-Tian He, Lei Liu et al.· 0 citations
Safety alignment of large reasoning models (LRMs) via supervised fine-tuning (SFT) and reinforcement learning (RL) often yields near-perfect safety scores, yet this apparent success comes at the cost of severe over-refusal and degraded general capabilities. Through systematic empirical analysis, we find that these fail...
Qi-Rui Liu, Yi-Chen Sun, Yan Wang et al.· 0 citations
SALA is proposed, a Semantic-Aware Logical Alignment framework that automatically learns task-specific reasoning operations and uses dynamic time warping to align the reasoning sequences.
Zhao-Jin Ji, Wen-Qing Chen, Zhi-Xuan Chu et al.· 0 citations
A conflict-driven preference optimization framework for model merging (CoMerge), which reformulates model merging as a preference optimization problem and utilizes a self-supervised, conflict-driven strategy that leverages the defects of naive merging methods as hard negative samples to construct preference pairs witho...
Ming-Jie Zheng, Zihao Chen, Wen-Qing Chen et al.· 0 citations
This work introduces AgentSnare, a trajectory-adaptive deception system that dynamically unfolds a decoy environment to continually steer the penetration agent away from the real target.
Ruoyu Wang, Heng Zhao, Renjie Wu et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.