Escaping Alignment: A Physical Trap Model of Best-of-N Jailbreaking
A simple barrier model is introduced where each prompt has a baseline safety level and each augmentation a random thermally activated barrier determines the entire ($N, M$) attack surface.
Marco Biroli
· 0 citations