The rapid advancement of cybersecurity agents in vulnerability discovery has increased the need for benchmarks that evaluate their capabilities accurately. However, synthetic benchmarks lack realism, real-life benchmarks are prone to contamination, and many existing benchmarks have already been saturated by current mod...
Rui Yang, Yi-Chao Xu, Zhuo-Hao Zhang et al.· 0 citations
This work systematizes MAS security through an execution-centered analysis of 197 works, introducing an A-I-R framework that organizes attacks by adversary position, interaction interface, and resulting system-level risk, unifying otherwise fragmented attack mechanisms across MAS.
Rui Yang, Jun-Jie Xu, Zheng-Yu Liu et al.· 1 citation
3R-Bench (Refusal, Repetition, and Revision), a benchmark of 150 real-world cybersecurity requests augmented with two adversarial conversational settings, is introduced and eight LLMs are evaluated, finding that prior assistant behavior strongly changes responses to an unchanged request.
Rui Yang, Yang Hong, Yi-Chao Xu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.