This work evaluates zero-shot phonetic classification on Chinese aspiration and Japanese moraic nasals and proposes a classification method based on continuous Articulatory Feature vectors extracted from each frame that outperforms discrete token-based methods, particularly for rare phones.
Abstract
Recent Phonetic Foundation Models (PFMs) for Speech-to-IPA transcription rely on Grapheme-to-Phoneme (G2P) labels, but the phoneme labels are not necessarily phonetically faithful. To investigate this issue, we evaluate zero-shot phonetic classification on Chinese aspiration and Japanese moraic nasals. A PFM trained on G2P-labeled data excluding these two languages yields poor accuracy on both tasks, showing that multilingual coverage with discrete IPA tokens is not sufficient for unseen settings. To overcome this limitation, we propose a classification method based on continuous Articulatory Feature (AF) vectors extracted from each frame. This AF-based approach outperforms discrete token-based methods, particularly for rare phones. We further show that it is crucial to adopt the optimal temporal aggregation of AF vectors for the target distinction: single-frame classification is best for aspiration, while segmental classification substantially improves nasal classification.
A linguistically structured approach to non-canonical phoneme recognition that decomposes phoneme prediction into articulatory feature dimensions such as manner, place, and voicing is introduced and suggests that articulatory feature supervision is a promising strategy for robust and interpretable phoneme recognition i...
Sophia Riaz, Haoze Zheng, Amos Roche et al.· 0 citations
This work demonstrates TAPA on the 2016 U.S. presidential debate, and suggests that TAPA can be used to increase access to naturalistic speech data and speed up the processing timeline with experts' supervision.
Ethan Kutlu, Emerson Peters, Ciara Tapanes et al.· Behavior Research Methods· 0 citations
This paper introduces a syllable-level UASR framework based on masked language modeling, which avoids the need for G2P and the instability of GAN-based methods and generalizes effectively to low-resource languages that have remained particularly difficult for prior methods.
Liming Wang, Kai-Wei Chang, K. Kashino et al.· 0 citations
Leading commercial and open-source Text-to-Speech (TTS) models fail to emulate the regional phonetic diversity of Brazilian Portuguese (pt-BR). By aggregating disparate dialects into a single training distribution, they generate a synthetic"diluted"accent: a phonetic profile attempting to represent all regional distrib...
Pedro H. L. Leite, P. Valadares, L. Biscainho· 0 citations
Broca, a Conformer-based deep learning system pretrained on 8 days of adult speech and fine-tuned on a 165-minute dataset of Italian child speech collected through a range of standardized diagnostic tests, demonstrates that accurate, vocabulary-independent speech-to-IPA transcription can be achieved with minimal data.
N. Barbaro, Cristina Gena, F. Petriglia et al.· 0 citations
Preliminary analyses show interpretable surface-sensitive patterns consistent with flapping-like /t/ realizations, /t/-/r/ retraction or affrication, and nasal place assimilation, indicating that phonological information from synchronized audio can be partially transferred to articulatory models.
Abner Hernandez, T. A. Vergara, Dai-Qi Liu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.