Large language models remain vulnerable to jailbreaks, and automated red teaming is the standard way to find jailbreaks in large language models at scale. Current methods either draw more samples at test time through search, rewriting, and tree expansion, or train a stronger attacker offline with reinforcement learning...
Tong-Yan Hu, Hao Li, Xiaogeng Liu et al.· 0 citations
Large language model (LLM) agents are increasingly deployed in tool-augmented environments, but their reliance on external inputs makes them highly vulnerable to prompt injection attacks that can hijack task objectives. Existing safety alignment methods rely on static expert trajectories or preference optimization, lim...
AutoDojo is introduced, a generative benchmark built on AgentDojo and AgentDyn that generates IPI adaptively for a given agent and defense, and it is demonstrated that standard static benchmarks often significantly overestimate defense efficacy.
Xinhang Ma, Taoran Li, Chao-Wei Xiao et al.· 5 citations
Internal representations thus support cross-mechanism attack-exposure auditing against calibrated benign references, but decouple from downstream task compromise and parameter integrity, according to downstream task compromise and parameter integrity.
Zhen Guo, Shang-Hao Shi, Shamim Yazdani et al.· 0 citations
It is argued that anomaly detection for agentic AI must reason at the workflow level, where global execution structure exposes signals that local checks cannot see, and presents Skynet, a principled workflow-level anomaly detection framework that turns observed multi-agent execution into directed workflow graphs and sc...
Chao-Yu Zhang, He-Xuan Yu, Heng Jin et al.· 0 citations
ROPE is presented, which is anchored in a structural notion of trust, and holds attack success rate to 1.6--2.6 while retaining 82--100% of undefended clean utility, significantly exceeding state-of-the-art system-level defenses in utility while attaining comparable or better security.
Xinhang Ma, Chao-Wei Xiao, William Yeoh et al.· 3 citations· ⚡2
TokenPilot is presented, a dual-granularity context management framework that reduces costs by 61% and 56% in isolated mode, and 61% and 87% in continuous mode, while maintaining competitive performance compared to prior systems.
Buqiang Xu, Z. Xue, Dian Chen et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.