One Geometry, Different Outcomes: Readout-Dependent Effects of the Modality Gap in Vision-Language Models
By clarifying when and why gap modification changes model behavior, this account provides a principled basis for selecting gap interventions in similarity-based vision-language systems across evaluated downstream tasks.