EXAM2: Extending Audio Understanding in Multilingual and Multimodal Analysis
This paper introduces EXAM, a benchmark for multilingual and multimodal audio understanding spanning six languages and multiple modalities, and evaluates state-of-the-art open-source and proprietary LALMs as well as multimodal LLMs, revealing substantial performance gaps in multilingual and cross-modal understanding.