ART-NAD is proposed, a reference-audio intelligibility metric that replaces the vocal-tract constriction variables of NAD with vocal-tract constriction variables predicted from audio by a speaker-independent acoustic-to-articulatory inversion model trained on the same \texttt{wav2vec2} features.
Abstract
Speech assessment tools for speakers with speech pathology must be both accurate and interpretable if they are to be adopted in clinical practice. Existing reference-audio measures such as the Neural Acoustic Distance (NAD) reach high speaker-level correlations with listener intelligibility scores but operate on self-supervised features that are hard to interpret, providing only frame-level explanations. We propose ART-NAD, a reference-audio intelligibility metric that replaces the \texttt{wav2vec2} features of NAD with vocal-tract constriction variables (tract variables, TVs) predicted from audio by a speaker-independent acoustic-to-articulatory inversion model trained on the same \texttt{wav2vec2} features. ART-NAD is computed as the multivariate Dynamic Time Warping distance between the nine-channel quasi-TV trajectories of the test and one or more references. Across 20 reference-audio protocols spanning six pathological-speech datasets and five languages, ART-NAD with silence trimming (ART-NAD-FA) reaches the same average speaker-level Pearson correlation as NAD-FA (both $r=0.71$) on the same self-supervised backbone, with no significant per-protocol difference (Wilcoxon $p=0.18$), and is the strongest reference-audio metric on 6 of the 20 protocols. Beside the score itself, each TV channel visualizes which constriction deviates from the reference over time, providing interpretable information as to where articulation breaks down.
Brain2Speech-Net is presented, among the first single-stage frameworks to remain intelligible under limited data while removing intermediate text decoding, and achieves strong intelligibility in objective and listening tests while running faster than real time.
This work proposes an acoustics-based assessment approach that employs a convolutional neural network to extract rhythm features directly from the speech amplitude envelope, motivated by evidence linking low-frequency modulations to rhythm perception.
João G. T. Lima, Lucas H. Ueda, P. Costa· arXiv.org· 0 citations
Unlike the original hypothesis, the standalone U-Net performed better in keyword recognition than the speech-target-oriented two-stage model, emphasizing the need for perceptual validation in evaluating speech-processing systems.
R. Viveros-Muñoz, Carla E. Contreras-Saavedra, Sebastián Guajardo-Herrera et al.· Scientific Reports· 0 citations
This work demonstrates TAPA on the 2016 U.S. presidential debate, and suggests that TAPA can be used to increase access to naturalistic speech data and speed up the processing timeline with experts' supervision.
Ethan Kutlu, Emerson Peters, Ciara Tapanes et al.· Behavior Research Methods· 0 citations
The findings identify the WST-based pipeline as a less speaker-dependent EMG feature representation that improves cross-subject performance across different sequence models and may provide a basis for intelligent EMG speech-recognition systems.
Jumana Ma'touq, Omar Abulayla, Rami N. Khushaba et al.· Italian National Conference...· 0 citations
This work proposes a framework that fine-tunes LALMs for dysarthric speech detection on speech recordings combined with textual information comprising low-level acoustic features and speaker demographics, and establishes an effective approach for adapting LALMs to dysarthric speech detection.
Mahdi Amiri, H. Shahreza, Pascal Frossard et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.