Heads of Security: Learned Attention Gates Improve Prompt Injection Robustness
Heads of Security (HoS), a prompt injection defense that enforces instruction-data separation via a small set of learned per-head attention gates, is introduced and shows that prompt injection robustness can be achieved and improved through targeted attention interventions.
Igor Shilov, Xiao-Xue Yang, Alexander Panfilov et al.
· 0 citations