What Standard Evaluations Hide About Detectors of Hijacked LLM Agents: Rare Attacks, Unseen Tools and Benchmark Transfer
A checklist for evaluating trace detectors is turned into a guide for evaluating trace detectors after finding that attacks or anomalies make up 16% to 86% of the test samples, no evaluation varies that share, and six report no test on data from a second benchmark or source.
Mahmoud Abbasi, V. JuanM.Núñez, A. Shahraki
· 0 citations