Measuring the Wrong Thing: Internal Harmfulness Scores Anti-Rank Successful Jailbreaks
Internal safety scores judge a prompt before any text is generated, and they are validated by how well they separate harmful prompts from benign ones, so Active Attention Probing is introduced, which supplies a fixed content independent measurement coordinate.