Vulnerability-detection benchmarks score the verdict an agent reaches, not the evidence it gathered. A model that recalls a CVE from pretraining therefore scores the same as one that traced the data flow. We study a task where this difference matters, deciding whether a commit introduces a vulnerability. Instead of sco...
Yi-Kun Li, Jin-Feng Jiang, Yuheng Yieh et al.· 0 citations
Evaluations across agent systems, benchmarks, and backbone LLMs under 65 fault configurations show that all systems degrade under fault injection, suggesting that robustness depends on system implementation rather than model capability.
Gou Tan, Zhensu Sun, Jie-Ke Shi et al.· Proceedings of the 41st IEEE...· 6 citations
The results suggest that LLMs can effectively bridge the gap between unstructured vulnerability reports and formal static analysis specifications, offering a scalable path toward comprehensive automated vulnerability detection.
Ivana Clairine Irsan, Ratnadira Widyasari, Hui-Hui Huang et al.· 0 citations
VulAgentRL is proposed, an agentic RL framework for interprocedural vulnerability detection built on a Code Property Graph (CPG), which outperforms state-of-the-art baselines, including frontier models, on the strict pair-wise-correct metric while issuing fewer tool calls, and its advantage persists on an out-of-distri...
Yi-Kun Li, Ting Zhang, Jia-Kun Liu et al.· arXiv.org· 2 citations
Experiments on real-world vulnerabilities show that CoSA consistently outperforms function-level and pure-LLM baselines, suggesting that explicit, metric-oriented repository context retrieval is crucial for practical and reliable automated severity assessment.
Jin-Feng Jiang, Yi-Kun Li, Cheng-Ran Yang et al.· 0 citations
Vul4Py is presented, a Python AVR benchmark in which every entry carries a paired oracle: an exploit oracle that must fail on the vulnerable revision and pass on the fixed one, together with a project-native pytest functional oracle that must pass on both.
Bui Tan, Ting Zhang, Ferdian Thung et al.· Lecture notes in computer sc...· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
