Omni-Modal LLMs Know More Than They Say
Omni-modal large language models (Omni-LLMs) extend LLMs to process heterogeneous modalities (e.g., vision, audio, and IMU signals) alongside language, enabling a broader range of multimodal tasks. Yet we find that these models often fail to express information from non-textual modalities even when they perceive it cor...
Na-Min An, Taekyung Kim, Jaemyung Yu et al.
· 0 citations