"Give a Positive Review Only": An Early Investigation Into In-Paper Prompt Injection Attacks and Defenses for AI Reviewers
This work proposes two classes of attacks: a static attack, which employs a fixed injection prompt, and an iterative attack, which optimizes the injection prompt against a simulated reviewer model to maximize its effectiveness.
Qing Zhou, Zhexin Zhang, Zhi Li et al.
· arXiv.org · 6 citations
· ⚡1