Skip to content

Bidirectional joint cross-attention framework for transformer based audio–visual emotion recognition

Aug 2026 · Signal, Image and Video Processing · Vol 20 · 0 citations · 34 references

TL;DR

Experiments show that the proposed framework outperforms unimodal baselines and existing fusion methods, indicating that the approach learns context-aware emotion representations well suited for accuracy-oriented audio–visual emotion recognition applications.

View source

Similar papers

Open access Aug 2026

Lightweight and robust audio-visual emotion recognition via multi-scale mamba temporal modeling and quality-aware expert fusion

Experiments demonstrate that the proposed lightweight audio-visual emotion recognition framework achieves competitive recognition accuracy with significantly fewer parameters and lower computational cost.

Tianxing Zhang, Hadi Affendy Bin Dahlan, Fadhilah Rosdi et al. · 0 citations
Open access 2026

Multimodal Emotion Recognition in Urdu through Late Fusion of Fine-Tuned Speech and Text Representations

This study proposes a multimodal deep learning framework for Urdu emotion recognition by integrating speech and text modalities that surpasses the existing UMEDNet benchmark, demonstrating the effectiveness of transformer-based feature extraction and multimodal late fusion for Urdu emotion recognition.

Muhammad Sheraz, Adil Majeed, Shehzad Khalid et al. · 0 citations
Review Jul 2026

Advancing emotion recognition: a novel adaptive audio–visual fusion approach

This work starts with a concise review of the field, emphasizing key steps for accurate emotion recognition, including feature extraction from both speech and facial modalities and classification using both traditional machine learning and modern deep learning techniques.

Hadhami Aouani, Y. Ben Ayed · 0 citations
Open access Jul 2026

Latency-Aware Hybrid Transformer–Capsule Network for Audio-Visual Emotion Recognition in Edge–Fog–Cloud Environments

This study proposes a latency-aware hybrid Transformer–capsule network for audio-visual emotion recognition in a simulated edge–fog–cloud environment that incorporates a deterministic latency-aware task-allocation mechanism for coordinating operations across edge, fog, and cloud resources.

Abhinav Shukla, Deepika Pahuja, Ayush Kumar Agrawal et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.