Han-Ze Cai

Learning to Prove, Not Just to Answer: Reinforcement Learning from Formal Verification for Natural-Language Logical Reasoning

Proof-R1 is proposed, an RL framework from formal verification that trains LLMs to construct verifiable proofs for natural-language logical reasoning and improves answer accuracy across three logical reasoning benchmarks and four backbone models and outperforms training-free agents and training-based methods in terms o...