Vittorio Murino AI For Good

From What to Which: Decoding Modifier Grounding in Frozen MLLMs

As Multimodal Large Language Models (MLLMs) can describe increasingly complex visual scenes, token-level grounding becomes crucial. Yet, when an MLLM generates"the yellow banana on the left", established grounding approaches focus on what is in the image ("banana"), overlooking tokens that help describe which instance...