J. Barua

Vision-Language Models Integrate Conflicting Evidence Like Biased Bayesian Observers

Vision-language models must reconcile conflicting text and images. Prior work has characterized the resulting behavior in terms of modality biases--e.g., a"blind faith in text"--but why preferences vary across models, domains, and input conditions remains unclear. We develop a predictive account from a Bayesian perspec...