Red-Teaming Multi-Agent Attacks for Loss-of-Control Risks
This work demonstrates distributed attacks, in which different agents carry out separate attack fragments, and how their covertness evades frontier monitors when reading their trajectories individually, and provides a foundation for preventing locally benign agent actions from accumulating into system-level loss of con...