AI agents are demonstrating increasingly strong offensive and defensive cybersecurity capabilities in the real world. Current benchmarks mostly evaluate agents in isolation against static targets. Real cyber operations, however, are dynamic and coupled: security postures constantly change as attackers and defenders ada...
Bangya Liu, Jianhong Tu, Yu-Jing Pan et al.· 0 citations
CyberArena is a dynamic, symmetric adversarial benchmark built around multi-round attack-and-defense combat, and introduces a dynamical model that maps match dynamics into unified, multidimensional scores across offensive, defensive, and domain-specific capabilities.
Bangya Liu, Jianhong Tu, Yu-Jing Pan et al.· 0 citations
Group alignment adapts a language model to a demographic group to produce responses that reflect the group's opinions, values, and preferences. Sycophancy, a well-documented by-product of alignment, causes the model to over-agree with the user regardless of factual and objective information. However, existing group ali...
Hao-Kai Zhao, Yunze Xiao, Wei-Hao Xuan et al.· 0 citations
This work proposes A-B-D to infer traits bottom-up from behavioral data (B-data), namely how agents act on their environment and communicate with users, as recorded in existing trajectories, and offers a new lens for understanding AI personality.
Hao-Kai Zhao, Jie Gao, Yunze Xiao et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.