A Conditional Speaker Normalization module is introduced that conditions the normalization process on speaker embeddings derived from either speaker verification systems or a speaker-height estimation model to mitigate the speaker-dependent nature of Log-Area Ratios.
Abstract
The rapid advancement of text-to-speech and voice conversion technologies has significantly improved the quality of synthetic speech, posing increasing challenges for developing reliable detection countermeasures. This study proposes a synthetic speech detection approach based on Log-Area Ratios (LARs) as acoustic features that provide a direct representation of vocal-tract shape. The underlying premise is that synthetic speech may exhibit inconsistencies in the speech production process that manifest as unnatural vocal-tract configurations, which can be captured through LAR features. To mitigate the speaker-dependent nature of LARs, we introduce a Conditional Speaker Normalization module that conditions the normalization process on speaker embeddings derived from either speaker verification systems or a speaker-height estimation model. These embeddings are processed through a set of fully connected layers to generate a bounded scaling vector that modulates the LAR features, improving their robustness and discriminative power in the evaluated setting. Experimental results show that the proposed approach improves performance on the FoR and Logical Access protocol of ASVspoof 2019 datasets, particularly with the speaker-height-related conditioning representation. Phoneme-level Integrated Gradients analysis indicates higher relative attribution to specific articulation categories, especially vowels. These patterns are consistent with a possible reduction in speaker-dependent articulatory variability, although the results do not establish that anatomical height information alone causes the improvement.
VOSSA (Voiceprint Optimization for Streaming Speech Architectures), a speaker representation framework that extracts speaker information from intermediate content encoder layers and aggregates using attentive statistics pooling, reduces the need for a separate speaker encoder, and improves F0 dynamics and vowel-discrim...
Mu-Ruei Tseng, Waris Quamer, Ghady Nasrallah et al.· 0 citations
A review of the current landscape and open problems in multimodal TSE from the perspective of auxiliary target cues drawn from multiple modalities and summarizes future directions concerning adaptive cue fusion, instruction-driven extraction, realistic evaluation, and trustworthy deployment.
Xin-Yuan Qian, Yang Zhou, Zi-Yang Jiang et al.· 0 citations
This study systematically explores the contribution of CMVNC features across two deep learning models, and juxtaposes them against the traditional i-vector/PLDA baseline under varying training and testing utterance lengths.
K. A. Al-Karawi, A. S. Alenizi, Naif Bin Saad Bin Mohammed AlGhamdi et al.· International Journal of Spe...· 0 citations
The transition from vocoder-based to neural-codec speech synthesis makes generalization more difficult for speech deepfake detectors, particularly those relying on speech-oriented representations. It remains unclear which acoustic representations retain discriminative information when the generation mechanism changes....
A new loss function is proposed, which helps mitigate the effect of excess silence in training, improving STOI, frequency-weighted segmental SNR, and frequency-weighted segmental SNR from 4.35 to 5.12.
Robert Sutherland, Stefan Goetze, Jon Barker· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.