Skip to content
Review

A survey of representation learning for multi-modal emotion recognition

Aug 2026 · Multimedia tools and applications · Vol 85 · 0 citations · 116 references

TL;DR

It is shown that benchmark performance alone is insufficient to assess multimodal affective understanding, and that future progress requires more robust, interpretable, context-aware, and generalizable representation learning frameworks for real-world MER.

View source

Similar papers

Review Open access Sep 2026

Towards Unified Affective AI: A Cross-Modal Survey of Emotion Recognition, Generation, and Control

This survey provides a comprehensive review of state-of-the-art methodologies for emotion recognition and generation across facial, speech, and textual modalities, covering preprocessing techniques, datasets, deep learning architectures, evaluation metrics, and emotion control mechanisms.

Rebecca Mobbs, Dimitrios Makris, Vasileios Argyriou · 0 citations
Conference Aug 2026

Human–Object Interaction as Affective Evidence for Multimodal Emotion Recognition

Emotion recognition is a key capability in human–robot interaction (HRI), but existing multimodal emotion recognition (MER) methods rely mainly on facial, vocal, and textual cues, which are often unreliable in practical HRI settings. In particular, occlusion and degraded or missing modalities can substantially reduce t...

Wen-Zhuo Sun, Xue-Lian Cheng, Richard Attfield et al. · 0 citations

EmoICL: Enhancing Visual Emotion Recognition with Emotion-Aware In-Context Learning.

Visual emotion recognition aims to infer human emotional states from visual cues. Adapting pretrained Vision-Language Models (VLMs) to this task remains challenging. In-Context Learning (ICL) enables a frozen model to condition its predictions on a few labeled demonstrations without task-specific fine-tuning. Here, dem...

Xi-Yang Li, Qu Yang, Yuwendong Yin et al. · 0 citations
Sep 2026

CLMER: A Framework for Contrastive Learning-Based Multimodal Emotion Recognition.

Experimental evaluations on two public datasets DEAP, AMIGOS and a private dataset MAN-II demonstrate that CLMER significantly outperforms unimodal and traditional fusion approaches, achieving state-of-the-art performance in emotion classification tasks.

Shuang Niu, Jian He, Yu Liang et al. · 0 citations
Review Open access Sep 2026

Affective Computing in Music: A Critical Review of Deep Learning’s Role and Its Alignment with Psychological Emotion Models

The precise identification of musical emotion holds substantial academic and practical value, with critical applications in music recommendation, therapeutic interventions, and real-time human–computer interaction. Conventional paradigms for music emotion recognition, predominantly based on manual feature engineering a...

Meng-Chen Zhou, Qi-Wen Jin · 0 citations
Conference Aug 2026

Uncertainty Aware Multimodal Framework for Fine-Grained Human Emotion Grading

Human emotion analysis is central to applications such as healthcare monitoring, human–computer interaction, education, and intelligent decision support systems. Existing emotion recognition approaches largely classify emotions into discrete categories rather than estimating fine-grained intensity levels, and typically...

Praveen Kulkarni, B. Maram, Sai Babu Veesam et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.