VisLens: Single-Pass Interpretable Visual Search for Multimodal LLMs
VisLens (Visual Focus via Logit Lens), a Visual Search method built on the logit lens, which decodes the semantics held in a hidden state by projecting it through the LLM head, and which matches or exceeds prior baselines while delivering a substantial latency advantage.
Jingfeng He, Sanghwan Kim, Zeynep Akata
· 0 citations