Skip to content

Improving Zero-Shot Phonetic Classification through Language-Agnostic Articulatory Features

Jul 2026 · arXiv.org · Vol abs/2607.23606 · 0 citations · 44 references
Computer Science Engineering

TL;DR

This work evaluates zero-shot phonetic classification on Chinese aspiration and Japanese moraic nasals and proposes a classification method based on continuous Articulatory Feature vectors extracted from each frame that outperforms discrete token-based methods, particularly for rare phones.

Abstract

Recent Phonetic Foundation Models (PFMs) for Speech-to-IPA transcription rely on Grapheme-to-Phoneme (G2P) labels, but the phoneme labels are not necessarily phonetically faithful. To investigate this issue, we evaluate zero-shot phonetic classification on Chinese aspiration and Japanese moraic nasals. A PFM trained on G2P-labeled data excluding these two languages yields poor accuracy on both tasks, showing that multilingual coverage with discrete IPA tokens is not sufficient for unseen settings. To overcome this limitation, we propose a classification method based on continuous Articulatory Feature (AF) vectors extracted from each frame. This AF-based approach outperforms discrete token-based methods, particularly for rare phones. We further show that it is crucial to adopt the optimal temporal aggregation of AF vectors for the target distinction: single-frame classification is best for aspiration, while segmental classification substantially improves nasal classification.

View source

Similar papers

Preprint Aug 2026

Multi-Task Learning for Non-Canonical Phoneme Recognition via Articulatory Feature Decomposition

A linguistically structured approach to non-canonical phoneme recognition that decomposes phoneme prediction into articulatory feature dimensions such as manner, place, and voicing is introduced and suggests that articulatory feature supervision is a promising strategy for robust and interpretable phoneme recognition i...

Sophia Riaz, Haoze Zheng, Amos Roche et al. · 0 citations
Open access Sep 2026

Toolkit for acoustic–phonetic analysis of naturalistic speech data

This work demonstrates TAPA on the 2016 U.S. presidential debate, and suggests that TAPA can be used to increase access to naturalistic speech data and speed up the processing timeline with experts' supervision.

Ethan Kutlu, Emerson Peters, Ciara Tapanes et al. · 0 citations
Preprint Aug 2026

Unsupervised Speech Recognition at the Syllable Level

This paper introduces a syllable-level UASR framework based on masked language modeling, which avoids the need for G2P and the instability of GAN-based methods and generalizes effectively to low-resource languages that have remained particularly difficult for prior methods.

Liming Wang, Kai-Wei Chang, K. Kashino et al. · 0 citations
Preprint Sep 2026

Synthetic speech detection in Brazilian Portuguese through accent-related features

Leading commercial and open-source Text-to-Speech (TTS) models fail to emulate the regional phonetic diversity of Brazilian Portuguese (pt-BR). By aggregating disparate dialects into a single training distribution, they generate a synthetic"diluted"accent: a phonetic profile attempting to represent all regional distrib...

Pedro H. L. Leite, P. Valadares, L. Biscainho · 0 citations
#machine learning Preprint Sep 2026

Deep Learning Techniques for Phoneme Recognition in Italian Children's Speech

Broca, a Conformer-based deep learning system pretrained on 8 days of adult speech and fine-tuned on a 165-minute dataset of Italian child speech collected through a range of standardized diagnostic tests, demonstrates that accurate, vocabulary-independent speech-to-IPA transcription can be achieved with minimal data.

N. Barbaro, Cristina Gena, F. Petriglia et al. · 0 citations
Preprint Aug 2026

Structured Phonological Representations for Audio-Articulatory rtMRI Speech Classification

Preliminary analyses show interpretable surface-sensitive patterns consistent with flapping-like /t/ realizations, /t/-/r/ retraction or affrication, and nasal place assimilation, indicating that phonological information from synchronized audio can be partially transferred to articulatory models.

Abner Hernandez, T. A. Vergara, Dai-Qi Liu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.