Skip to content

Vocal Music under Phoneme-Conditional Analysis

Aug 2026 · 0 citations · 55 references
Computer Science Engineering

Abstract

The vocal music of each language carries a distinctive sonic identity, even without instrumental accompaniment. We ask whether these differences are measurable and traceable to specific phonemes. To tackle this question, we introduce phoneme-conditional analysis, which isolates the acoustic effect of typologically distinctive phonemes by comparing marker syllables against matched non-marker controls within the same song, holding singer, melody, and genre constant. Across nine typologically diverse languages and thousands of songs, we measure effects along five acoustic dimensions. Song-level profiles built from these effects identify the language of an unaccompanied vocal at 85.5% balanced accuracy in a nine-way classification with folds grouped by artist; whether the separability arises by accumulation of the phoneme-local effects themselves is left open. Our findings suggest that phonological structure leaves systematic and measurable traces in how each language is sung.

View source

Similar papers

2026

Timbre Semantics of the Singing Voice

Despite the growing body of research on instrumental timbre semantics, the semantics of the singing voice remains notably underexplored—a striking omission, given its fundamental role in human communication and musical expression. Here, we model vocal timbre semantics across a range of musical styles through content an...

Lindsey Reymore, Theodora Nestorova, Jay Marchand Knight et al. · 2 citations
Preprint Aug 2026

Letters hide the truth from our eyes: English homophones have meaningfully different phonetic realizations

The distribution of spoken word duration of English homophones is known to co-vary with frequency of use. This study investigates whether other aspects of the phonetic realization of homophones also differ. A series of quantitative investigations of 14,000 homophone tokens in American television news broadcasts reveale...

Yu-Hsiang Tseng, Mirjam Ernestus, L. ten Bosch et al. · 1 citation
#machine learning Preprint Oct 2026

Phonological Interference in Multilingual Speech Models

Phoneme-level models transcribe or generate speech as a sequence of phonemes, the smallest sound units that distinguish words. These models enable fine-grained pronunciation control and understanding, yet often fail on input that does not match any single training language, such as speech alternating between two langua...

Moran Yanuka, Raja Giryes, Morris Alper · 0 citations
#artificial intelligence Preprint Sep 2026

Structure Across Voices: Comparing acoustic-event type accumulation and sequence dependence across four vocal repertoires using frozen audio encoders

Vocal repertoires can differ in acoustic-event type accumulation and temporal organization, yet direct comparison is difficult because corpora use different native events and unequal amounts of sequence. We compare sperm whale codas, human speech phones, Bengalese finch syllables, and common marmoset calls using the sa...

Mudit Sinha, Sanika Chavan · 0 citations
#machine learning Preprint Sep 2026

Do Audio Language Models Hear and Read Distinctive Features Alike?

Audio language models pass speech and text through a single decoder. We ask whether that decoder represents a distinctive feature in the same direction when a phoneme is heard and when it is read. For minimal pairs of phonemes differing in one feature, we take the offset between the two members'mean representations. Av...

Yuanhao Chen, Peter Chin · 0 citations
Sep 2026

String Musicians and Vocal Expressivity in Early and Modern Recordings of Schubert’s Ave Maria

Portamento use by classical singers and string players in recordings of Ave Maria by Schubert from two different time periods (1906–1931 and 1999–2020) is examined in this study to compare the presence of voice-mimicking characteristics in performances by cellists and violinists. Furthermore, an additional detailed...

Gabrielle Kaufman · 0 citations

Related blog posts

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.