T. Pham

Red-Teaming Multi-Agent Attacks for Loss-of-Control Risks

This work demonstrates distributed attacks, in which different agents carry out separate attack fragments, and how their covertness evades frontier monitors when reading their trajectories individually, and provides a foundation for preventing locally benign agent actions from accumulating into system-level loss of con...