Learning to Prove, Not Just to Answer: Reinforcement Learning from Formal Verification for Natural-Language Logical Reasoning
Proof-R1 is proposed, an RL framework from formal verification that trains LLMs to construct verifiable proofs for natural-language logical reasoning and improves answer accuracy across three logical reasoning benchmarks and four backbone models and outperforms training-free agents and training-based methods in terms o...
Qi-Li Zhang, Qian-Ren Mao, Han-Ze Cai et al.
· 0 citations