Visual Question Answering (VQA) imposes substantial computational overhead on vision-language models (VLMs), motivating model-agnostic input reduction methods that can be readily applied across diverse VLMs, including in black-box settings. Simply enforcing a visual-token cap reduces computation, but it can discard inf...
BrainFocus is proposed, a reliable EEG-guided efficient VLM framework for VQA that improves VQA accuracy and demonstrates that EEG can guide efficient VLM inference even when its semantic decoding is imperfect.
It is reported that the nonuniform semistructured framework detects critical layers and that, as demonstrated through successive pruning experiments, their preservation from pruning greatly reduces performance degradation, compared to a fully pruned model.
Ann Marini, Qinyu Chen, Nusa Zidaric· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.