Skip to content

AOI-Net: Structural Face AOI-Guided Eye-Gaze Track Representation Learning for Autism Spectrum Disorder Detection

Aug 2026 · 0 citations · 57 references
Computer Science

TL;DR

A structural face AOI-guided Eye-Gaze Track Network (AOI-Net) that jointly models short-term temporal dynamics and AOI-level structural organization and enables interpretable gaze-behavior modeling and provides a practical basis for scalable AI-driven ASD screening in real-world healthcare.

Abstract

Eye-movement tracking has emerged as a promising non-invasive approach to Autism Spectrum Disorder (ASD) screening, with systematic differences in attentional allocation and revisit behaviors observed during socially interactive tasks. Existing computational methods typically characterize eye-movements using discrete gaze trajectories and fixation events, yielding representations dominated by short-range temporal dynamics and limiting models that primarily emphasize long-range dependencies. Meanwhile, gaze behavior is naturally organized across semantically meaningful Areas of Interest (AOIs), whose attention allocation and transitions provide important structural cues, yet their relationships are rarely modeled explicitly. To address these limitations, we propose a structural face AOI-guided Eye-Gaze Track Network (AOI-Net) that jointly models short-term temporal dynamics and AOI-level structural organization. A network gating mechanism adaptively integrates the complementary temporal and structural representations according to their contributions to gaze-behavior characterization. To mitigate the pronounced class imbalance commonly encountered between individuals with ASD and Typically Developing (TD) participants in clinical datasets, class-distribution-aware learning is further employed to facilitate discriminative embedding learning under skewed class distributions. Experiments on a unique and large-scale clinical eye-tracking database comprising eight stimulus subsets and more than 1,300 participants show that AOI-Net consistently outperforms state-of-the-art methods. The proposed framework also enables interpretable gaze-behavior modeling and provides a practical basis for scalable AI-driven ASD screening in real-world healthcare. The code is available at https://github.com/Zhanpei-ai/CIM-AOI-Net/tree/main/Code

View source

Similar papers

Book Oct 2026

Joint Attention Modeling in Naturalistic Interactions with Social Gaze and Proximity Cues

Joint attention (JA) is a core mechanism of social interaction, supporting coordination, knowledge transmission and early language development; deficits in JA are also a key early indicator of autism. While prior computer vision work often operationalizes JA as frame-based co-attention to a shared target, cognitive sci...

M. Dickerman, Michael Villamizar, Sabine Stoll et al. · 0 citations
Open access 2026

Decoding Social Information from Biological Motion in the Broad Autism Phenotype: An Eye-Tracking Study

The term broad autism phenotype (BAP) refers to individuals who do not meet the diagnostic criteria for autism but share some of its features, including social difficulties and atypicalities in visual perception and attention that have been linked to a detail-oriented cognitive style. To examine both the cognitive and...

E. Gavrilova, Anna Izmalkova, Ksenia Novoselova et al. · 0 citations
Preprint Sep 2026

Active Visual Semantics: A large-scale MEG and eye-tracking dataset for understanding visual intelligence in action

Here we present the Active Visual Semantics (AVS) dataset, a large-scale collection of magnetoencephalography (MEG) and eye-tracking data recorded while five participants freely explored 4,080 natural scenes over 10 sessions each, yielding more than 200,000 fixation epochs in total. Unlike existing neuroimaging dataset...

Philip Sulewski, Carmen Amme, P. König et al. · 0 citations
Open access Aug 2026

Multi-head attention-driven multimodal feature integration network for autism spectrum disorder detection

Experimental evaluation on the proposed multi-head Attention-driven Multimodal Feature Integration Network framework demonstrates that the proposed MAtMFIN framework consistently outperforms state-of-the-art transfer learning and Deep Learning models, including a hybrid Convolutional Neural Network (CNN)-Long Short-Ter...

A. R., Radha Senthilkumar · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.