The rapid advancement of cybersecurity agents in vulnerability discovery has increased the need for benchmarks that evaluate their capabilities accurately. However, synthetic benchmarks lack realism, real-life benchmarks are prone to contamination, and many existing benchmarks have already been saturated by current mod...
Rui Yang, Yi-Chao Xu, Zhuo-Hao Zhang et al.· 0 citations
Scientific discovery with language models requires finding the best valid solution within a finite computational budget. We study how feedback from this search can improve the procedure used to conduct it. We introduce HarnessTTT, a test-time learning framework that trains a harness proposer while keeping the executor...
Ying-Zi Ma, Yu-Long Cao, Nan-Xi Li et al.· 0 citations
It is proved that the achievable security and utility tradeoff depends entirely on how benign requests for the same capabilities are grouped, and that the achievable security and utility tradeoff depends entirely on how persistent, recognizable groups permit a useful defense.
Bowen Sun, Zhengyue Zhao, Xiaogeng Liu et al.· 1 citation
Large language models remain vulnerable to jailbreaks, and automated red teaming is the standard way to find jailbreaks in large language models at scale. Current methods either draw more samples at test time through search, rewriting, and tree expansion, or train a stronger attacker offline with reinforcement learning...
Tong-Yan Hu, Hao Li, Xiaogeng Liu et al.· 0 citations
EvoSafeHarness is a safety-specific optimization framework that synthesizes a deployable harness for a frozen model in a target domain, guided by model behavior, domain specifications, and fresh-context adversarial review to reject benchmark-specific rules.
Nanxi Li, Ying-Zi Ma, Yulong Cao et al.· 2 citations
KeyPooling is presented, a measurement method that traces customer identity through cache lookup and write, verifies runtime transformations, and tests one predicted identity component at a time, and derives a defense contract.
Bowen Sun, Yixi Cai, Xiaogeng Liu et al.· 0 citations
