Shi-Yu Wang

SAVeR$^2$: Reasoning-based Safety Alignment for Large Reasoning Models via Verifiable Rewards

This work formalizes LRM safety objectives as requiring non-malicious reasoning and answers, safety consistency, and explicit intent identification, and introduces a reasoning-preserving gradient projection mechanism that analytically resolves conflicts between safety and reasoning gradients, effectively eliminating th...