We present the results of the VoiceMOS Challenge 2026, the fifth edition of a scientific challenge on automatic prediction of subjective speech assessments. After expanding the scope to music and general audio in 2025, we refocused the evaluation target on speech and organized three tracks: prediction of absolute and c...
Wen-Chin Huang, Wei Wang, Marvin Sach et al.· 0 citations
This paper introduces EXAM, a benchmark for multilingual and multimodal audio understanding spanning six languages and multiple modalities, and evaluates state-of-the-art open-source and proprietary LALMs as well as multimodal LLMs, revealing substantial performance gaps in multilingual and cross-modal understanding.
Jia-Wen Wang, Xiao-Xue Gao, Ziliang Pang et al.· 0 citations
This paper comprehensively studies effective prompt injection attacks against 14 widely used open-source and three closed-source LLMs on five attack benchmarks and proposes a straightforward and effective hypnotism attack, showing that this attack causes aligned language models to generate objectionable behaviors.
Jia-Wen Wang, Pritha Gupta, E. Hüllermeier et al.· 9 citations
The causes of modal divergence are probed, offering insights into fostering culturally robust MLLMs, and a Multilingual, Multimodal Alignment framework for Cultural grounding evaluation is proposed.
Weihua Zheng, Zhengyuan Liu, Tanmoy Chakraborty et al.· Annual Meeting of the Associ...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
