When an image and its caption disagree, can a user reliably control which one a vision-language model (VLM) follows? Accuracy alone cannot answer this question, since a model might give the correct answer from parametric knowledge without following the requested evidence. We therefore evaluate modality grounding contro...
M. Dassen, Alexander Martin, Andrew Yates et al.· 0 citations
An expert human evaluation is conducted, measuring summary preferences based on information satisfaction given a specific person’s background and use case, and finds that both traditional and LLM-based metrics are insufficient measures of information satisfaction and agree poorly with human judgment.
Isabel Cachola, W. Walden, Reno Kriz et al.· Proceedings of the 2026 ACM...· 0 citations
MultiVENT-Raw is released, a multilingual collection of nearly 120,000 primarily raw videos paired with 130 events and 222 event-centric queries, along with human-annotated video relevance judgments and human-extracted key facts for relevant videos.
Reno Kriz, David Etter, Alexander Martin et al.· arXiv.org· 0 citations
We propose LAYERSCOPE, a label-free, layerwise framework that aims to characterize a model's learned representations in video and multimodal settings. Evaluating downstream performance using representations from final or intermediate layers typically requires large amounts of labeled data, repeated task-specific evalua...
Sandra Arcos-Holzinger, Debashish Chakraborty, Rohita Mocharla et al.· 0 citations
CLUE (Calibrated Latent Uncertainty Estimation), which combines self-consistent teacher calibration and distribution-based confidence probing to produce calibrated predictions, is introduced, which achieves equivalent or stronger performance than zero-shot baselines up to 32B parameters across all modalities.
Dengjia Zhang, Alexander Martin, William Jurayj et al.· arXiv.org· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.