Skip to content

ART-NAD: An Articulatory Inversion-based Neural Acoustic Distance for Pathological Speech Intelligibility Assessment

Sep 2026 · arXiv.org · Vol abs/2609.24046 · 0 citations · 46 references
Computer Science

TL;DR

ART-NAD is proposed, a reference-audio intelligibility metric that replaces the vocal-tract constriction variables of NAD with vocal-tract constriction variables predicted from audio by a speaker-independent acoustic-to-articulatory inversion model trained on the same \texttt{wav2vec2} features.

Abstract

Speech assessment tools for speakers with speech pathology must be both accurate and interpretable if they are to be adopted in clinical practice. Existing reference-audio measures such as the Neural Acoustic Distance (NAD) reach high speaker-level correlations with listener intelligibility scores but operate on self-supervised features that are hard to interpret, providing only frame-level explanations. We propose ART-NAD, a reference-audio intelligibility metric that replaces the \texttt{wav2vec2} features of NAD with vocal-tract constriction variables (tract variables, TVs) predicted from audio by a speaker-independent acoustic-to-articulatory inversion model trained on the same \texttt{wav2vec2} features. ART-NAD is computed as the multivariate Dynamic Time Warping distance between the nine-channel quasi-TV trajectories of the test and one or more references. Across 20 reference-audio protocols spanning six pathological-speech datasets and five languages, ART-NAD with silence trimming (ART-NAD-FA) reaches the same average speaker-level Pearson correlation as NAD-FA (both $r=0.71$) on the same self-supervised backbone, with no significant per-protocol difference (Wilcoxon $p=0.18$), and is the strongest reference-audio metric on 6 of the 20 protocols. Beside the score itself, each TV channel visualizes which constriction deviates from the reference over time, providing interpretable information as to where articulation breaks down.

View source

Similar papers

Preprint Sep 2026

Brain2Speech-Net: Intelligible, Real-Time Brain-to-Speech Synthesis Without Text Decoding

Brain2Speech-Net is presented, among the first single-stage frameworks to remain intelligible under limited data while removing intermediate text decoding, and achieves strong intelligibility in objective and listening tests while running faster than real time.

Shreeram Suresh Chandra, Ze-Xin Cai, Yu Tsao et al. · 0 citations
Sep 2026

Automated Assessment of L2 Speech Rhythm Using Low-Frequency Amplitude Modulations

This work proposes an acoustics-based assessment approach that employs a convolutional neural network to extract rhythm features directly from the speech amplitude envelope, motivated by evidence linking low-frequency modulations to rhythm perception.

João G. T. Lima, Lucas H. Ueda, P. Costa · 0 citations
Open access Sep 2026

Speech intelligibility comparison of standalone and two-stage deep learning architectures for behind-the-ear-to-binaural enhancement

Unlike the original hypothesis, the standalone U-Net performed better in keyword recognition than the speech-target-oriented two-stage model, emphasizing the need for perceptual validation in evaluating speech-processing systems.

R. Viveros-Muñoz, Carla E. Contreras-Saavedra, Sebastián Guajardo-Herrera et al. · 0 citations
Open access Sep 2026

Toolkit for acoustic–phonetic analysis of naturalistic speech data

This work demonstrates TAPA on the 2016 U.S. presidential debate, and suggests that TAPA can be used to increase access to naturalistic speech data and speed up the processing timeline with experts' supervision.

Ethan Kutlu, Emerson Peters, Ciara Tapanes et al. · 0 citations
Open access Oct 2026

Wavelet Scattering Features for Robust Subject-Independent EMG-Based Speech Recognition: A Comparative Analysis

The findings identify the WST-based pipeline as a less speaker-dependent EMG feature representation that improves cross-subject performance across different sequence models and may provide a basis for intelligent EMG speech-recognition systems.

Jumana Ma'touq, Omar Abulayla, Rami N. Khushaba et al. · 0 citations
Preprint Oct 2026

Augmenting Large Audio Language Models with Low-Level Acoustic Features for Dysarthric Speech Detection

This work proposes a framework that fine-tunes LALMs for dysarthric speech detection on speech recordings combined with textual information comprising low-level acoustic features and speaker demographics, and establishes an effective approach for adapting LALMs to dysarthric speech detection.

Mahdi Amiri, H. Shahreza, Pascal Frossard et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.