Skip to content
Preprint

MuSP-Bench: Advanced Multimodal Benchmarking of Music Understanding across Score and Performance

Aug 2026 · 0 citations · 21 references
Computer Science

Abstract

Musicians commonly communicate music through scores and performances. Scores encode musical intent, while performances realize it in sound. To investigate whether models can meaningfully engage with both modalities, we introduce MuSP-Bench, a human-authored benchmark of 490 questions targeting understanding across Musical Scores and Performances. The benchmark distinguishes itself by spanning score-based, performance-based, interpretive, and long-horizon reasoning across classical piano and orchestral works. We evaluate frontier multimodal large language models under multiple input conditions. Our results show that these models struggle substantially to understand scores, while facing even greater challenges when reasoning about performance audio. The benchmark is available at https://musp.vaclis.net/.

View source

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.