It Is Not Seeing the Hazard: A Frozen Vision-Language Safety Score Measures Its Caption Bank
Frozen vision-language models increasingly provide safety signals for reinforcement learning. Their use assumes that similarity to language describing danger indicates the hazard itself. Yet policy return and collision rate cannot reveal whether a score detects hazards or responds to correlated features of the scene. V...