Skip to content

Gaze-Driven Efficient Inference for Vision-Language Models

Unknown authors
· 0 citations · 24 references

TL;DR

It is suggested that human gaze provides an effective and practical guidance signal for improving the computational efficiency of Vision-Language Models without requiring changes to the underlying models, offering a simple and general approach for reducing visual inference cost while largely preserving answer quality.

View source

Similar papers

Preprint Oct 2026

GazeAct: A Human-Gaze-Annotated Manipulation Dataset for Attention-Regularized Policies

Vision-language-action (VLA) policies must ground language instructions in the right objects, contact points, and target locations for reliable manipulation. Human gaze provides a natural signal for this grounding, but existing robot datasets rarely pair real human gaze with the multi-camera observations used by modern...

Anupam Pani, Wang-Gui Yuan, Qi-Fan Wang et al. · 0 citations
Sep 2026

OpenVAM: Open-World Visual Attention Modeling with VLMs

Predicting human gaze is a core capability for applications ranging from web/UI design analysis to robotics and human-computer interaction. Yet, most visual attention modeling methods output only a dense saliency map, which is often insufficient for action: practitioners need to connect attention peaks to discrete elem...

Kiana Hooshanfar, Amirhossein Kazerouni, Alireza Hosseini et al. · 0 citations
Preprint Oct 2026

Loop to Look Better: Learning Adaptive Depth for Question-Guided Perception in Vision-Language Models

Visual perception should be iterative and task-directed, with representations refined in response to the question and the need for further processing. While Vision-Language Models (VLMs) increasingly support extended reasoning, their visual tokens are still typically acquired in a single, task-agnostic encoder pass. Th...

Wen Ye, An-Ning Hu, Hong-Ye Fang et al. · 0 citations
Sep 2026

ConvCue: Complementary Visual Inductive Biases for Vision-Language Models

Results show that pretrained convolutional representations, when integrated through learned adaptation and fusion, can improve the visual understanding of existing VLMs without replacing their original visual encoders.

Zi-Xuan Lan, Shi-Chu Sun · 0 citations
Preprint Oct 2026

Look Before You Reason: Implicit Visual Thinking for Efficient Multimodal Reasoning

Vision-language models (VLMs) have advanced rapidly in multimodal reasoning, yet they remain limited on tasks requiring fine-grained understanding of small or easily overlooked image regions. Recent thinking with images approaches mitigate this limitation by allowing models to inspect images through operations such as...

Ze-Rui Chen, Chang-Rui Chen, Fei Ni et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.