Skip to content
Open access

Evaluating Phonological Knowledge in Foundational Speech Models

Sep 2026 · The 12th ISCA-SAC Doctoral Consortium (DC2026) · 0 citations · 11 references

Abstract

Speech foundation models are primarily evaluated with task-level metrics, which do not establish whether language-specific phonological patterns are encoded or faithfully reproduced. This dissertation asks what evidence is required to distinguish recoverable acoustic or distributional information from phonological generalization in speech models. Assamese Advanced Tongue Root (ATR) vowel harmony provides the primary test case because its production pattern combines acoustic vowel contrasts with long-distance, directional dependencies. Four interconnected studies examine (i) the acoustic-phonetic realization of ATR in human speech, (ii) generative learning with fiwGAN, (iii) process-level probing of frozen self-supervised speech models, and (iv) phonological faithfulness in multilingual TTS. Results so far show that ATR-and harmony-correlated information can be highly recoverable even when model behavior does not exhibit the structural signatures expected of Assamese harmony. The dissertation, therefore, develops evaluation criteria that distinguish phonetic recoverability from evidence for phonological process encoding, with implications for speech technologies in typologically diverse and low-resource languages.

Read PDF

Similar papers

#natural language process... Preprint Oct 2026

Child-Adapted Structured Phonological Representations for Interpretable Speech Sound Analysis

Structured phonological representations provide an interpretable alternative to generic speech embeddings, but existing models are largely trained on adult speech. We adapt PhonoQ-2.0 to child speech using CHILDES-Aligned data and compare three alignment-supervision conditions (Adult, Adult+Child, and Child-only) acros...

Abner Hernandez, T. A. Vergara, Andreas K. Maier et al. · 0 citations
Open access Oct 2026

Fossilized Phonetic and Phonological Errors among ESL University Students in Jordan: Evidence from Interlanguage, Markedness, and Speech Perception Models

Persistent pronunciation difficulties remain evident even among advanced learners of English, yet it is still unclear whether such patterns reflect stabilized interlanguage representations or merely limited responsiveness to short-term instruction. This study investigates recurrent phonetic and phonological errors amon...

T. Al-Shamayleh, Mohammad Hanaqtah, M. Al-Smaihyeen et al. · 0 citations
#natural language process... Preprint Nov 2026

Phonological Knowledge of Chinese Characters in Language Models

How much phonological knowledge do language models (LMs) possess about Chinese characters, and how is this knowledge represented and used? We introduce PinyinBench, a controlled benchmark covering homophones, phonological features (initials, finals, and tones), and polyphonic characters. We investigate 17 text-only and...

Xiao-Zhe Ji, Ren-Fen Hu, Hai Hu · 0 citations
#machine learning Open access Oct 2026

Phonologically Informed Tokenization for German Speech Recognition: A Cross-Domain Study

German is a morphologically rich language whose syllable structure is exceptionally well-predicted by the Knuth--Liang hyphenation algorithm. We ask whether phonologically informed tokenization can serve as a competitive target for end-to-end speech recognition. We compare three tokenizer families on the Omnilingual AS...

Christopher Witzl, Tobias Bocklet, Korbinian Riedhammer · 0 citations
#machine learning Preprint Oct 2026

Phonological Interference in Multilingual Speech Models

Phoneme-level models transcribe or generate speech as a sequence of phonemes, the smallest sound units that distinguish words. These models enable fine-grained pronunciation control and understanding, yet often fail on input that does not match any single training language, such as speech alternating between two langua...

Moran Yanuka, Raja Giryes, M. Alper · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.