PatchBench: Evaluating AI Agents for Vulnerability Patching
A patch similarity metric is introduced to detect memorized patches and new patch validation methods are developed that thoroughly evaluate both security and semantic correctness of agent patches for vulnerability patching.
Chihao Shen, Jia-Cheng Li, Aastha Mahajan et al.
· 0 citations