Skip to content
Conference

Infant and toddler facial expression recognition based on topology-aware pooling graph U-Net

Aug 2026 · International Conference on Digital Image Processing · Vol 14351, pp. 143512J - 143512J-12 · 0 citations · 38 references
Engineering

TL;DR

This paper proposes a Topology-Aware Pooling Graph U-Net for infant facial expression recognition in natural scenes, the first work to introduce Graph U-Net into this domain and demonstrates its robustness and effectiveness.

Abstract

Facial expressions are essential for infants and toddlers to communicate emotions and interact socially. Accurate recognition of these expressions is vital for understanding their needs and enhancing adult-child communication. However, this task is challenging due to the subtlety of infant expressions, environmental interference, and the inherent small inter-class but large intra-class differences in early emotional development. To address these challenges, this paper proposes a Topology-Aware Pooling Graph U-Net for infant facial expression recognition in natural scenes. This is the first work to introduce Graph U-Net into this domain. The model constructs graph structures to capture similarity relationships among feature vectors, enabling deep exploration of topological information in high-dimensional features. A novel topology-aware graph pooling mechanism is designed to effectively assess node importance within the graph. Experimental results on the IFER dataset show that the proposed method achieves 93.22% accuracy, outperforming state-of-the-art approaches. It excels in distinguishing visually similar expressions such as "startle" (90.41%) and "crying" (95.03%), demonstrating its robustness and effectiveness.

View source

Similar papers

Open access Oct 2026

OQ-FERNet: An occlusion-aware quantitative facial expression recognition network for real-time human-computer interaction

OQ-FERNet achieves competitive classification performance, improved robustness under different occlusion conditions, and effective quantitative emotion prediction, indicating that OQ-FERNet provides an effective and efficient solution for lightweight, occlusion-robust, and fine-grained facial expression recognition in...

Lian-Fei Gao, Jun-Feng Tan, Jia-Hao Zhang · 0 citations
Open access Aug 2026

Transformer With Decoupled Self-Attention Regularization for Age-Unbiased Facial Expression Recognition

A novel bias-mitigation method that decouples and regularizes age- and emotion-related components within the self-attention mechanism of Transformer to reduce age-related bias and enhance age-invariant emotion separation is proposed.

Jaeil Park, Sung-Bae Cho · 0 citations
Sep 2026

Hybrid convolutional neural network with attention mechanism to provide robust face expression recognition

A hybrid model which uses several ResNet50 mixed with VGG16 backbones to improve the local facial features with the global context for a robust FER solu-tion, and shows superior robustness to occlusions and pose, even under cross-dataset testing.

A. Ouza, Mohamed El Ghmary, A. Choukri · 0 citations
Conference Oct 2026

HTNet-SDGCN: hierarchical transformer with structural-dynamic dual graph convolutional network for micro-expression recognition

Micro-expression recognition (MER) is a fundamental yet challenging task in affective computing due to the subtle, transient, and localized nature of spontaneous facial muscle movements. Although Vision Transformers effectively extract MER features, spatial regions are often processed in isolation, limiting the ability...

Xi-Chang An, Chao-Long Zhang, Yuan-Ping Xu et al. · 0 citations
Open access Aug 2026

FER20E: An Extended Facial Expression Recognition Dataset With 20 Discrete Emotions

The FER20E dataset provides a comprehensive benchmark for advancing emotion recognition in unconstrained and real-world scenarios, and a data annotation tool (DL-DAT) that follows a semi-automated, human-in-the-loop pipeline to enable scalable and reliable annotation.

Kuldeep Singh Yadav, Lalan Kumar · 2 citations
Open access Aug 2026

An Attention-Enhanced ConvNeXtTiny Model for Robust Facial Expression Recognition

Facial Expression Recognition (FER) plays an important role in affective computing and human–computer interaction by enabling automated interpretation of human emotional states from facial images. Despite recent advances in deep learning, reliable FER remains challenging because of variations in facial appearance, illu...

Manisha B. Thombare, S. Gumaste · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.