Skip to content

Lightweight speech emotion recognition: integrating acoustic-aware augmentation and confusion matrix-guided adaptive training

Aug 2026 · Signal, Image and Video Processing · Vol 20 · 0 citations · 23 references
Computer Science

TL;DR

An acoustic-aware augmentation strategy grounded in arousal-valence theory to expand minority-class samples while preserving semantic validity and a Confusion Matrix-guided Adaptive Training (CMAT) mechanism, which dynamically adjusts sampling probabilities and loss weights based on periodic confusion matrix feedback.

View source

Similar papers

Open access Sep 2026

Zero-shot emotional speech synthesis based on feature decoupling and adaptive loss-threshold reweighting

Deep learning-based zero-shot speech synthesis has achieved substantial progress in speaker generalization, but stable modeling remains challenging in fine-grained emotional scenarios. Existing systems often process textual and emotional conditions through shared or closely coupled pathways, which may introduce interfe...

Yan Zhu, Yu Wang, Yi-Jin Zhou et al. · 0 citations
#natural language process... Preprint Sep 2026

Emotion as a Distribution: Joint Valence-Arousal Probability Learning for Speaker-Independent Multimodal Emotion Recognition

This text+speech system, alongside its categorical decision, emits a $9\times9$ probability matrix over the Valence-Arousal plane, trained with a two-dimensional Gaussian soft target under a Kullback-Leibler/cross-entropy objective, aimed at counseling support.

Ting Lin, Wen-Ren Yang, Kuan-Wei Chen · 0 citations
2026

ASER: Attribute-Serialized Emotion Recognition With Generative Multi-Task Learning

Speech emotion recognition (SER) is commonly formulated as direct utterance-to-label classification, leaving the acoustic and semantic evidence behind each prediction implicit. This letter proposes Attribute-Serialized Emotion Recognition (ASER), an attribute-serialized generative multi-task framework for SER, which or...

Ying-Ming Gao, Yi-Ming Gao, Rui-Xi Jiang et al. · 0 citations
Open access Aug 2026

Hybrid CNN-embedding fusion with MFCC-SVM for speech emotion recognition: Random vs actor-wise evaluation on CREMA-D

The results show that a controlled lightweight fusion framework can improve robustness while making the performance gap between speaker-overlapping and speaker-independent evaluation explicit, and improve robustness while making the performance gap between speaker-overlapping and speaker-independent evaluation explicit...

Parveen Kumari, Yogita Yashveer Raghav, Vimmi Kochher et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.