Style Over Substance: Content-Invariant Wrappers Flip LLM Safety-Judge Verdicts
Automatic safety judges -- for example Llama Guard, or GPT-4o given a grading prompt -- produce the numbers behind reported jailbreak success rates, defense evaluations, and safety leaderboards. We ask whether these judges grade what a reply contains or how it sounds. We place a fixed piece of text before or after a mo...
Yong-Xin Zhou, Wen-Bo Ye, Yuan-Zhe Liu et al.
· 0 citations