A structural face AOI-guided Eye-Gaze Track Network (AOI-Net) that jointly models short-term temporal dynamics and AOI-level structural organization and enables interpretable gaze-behavior modeling and provides a practical basis for scalable AI-driven ASD screening in real-world healthcare.
Abstract
Eye-movement tracking has emerged as a promising non-invasive approach to Autism Spectrum Disorder (ASD) screening, with systematic differences in attentional allocation and revisit behaviors observed during socially interactive tasks. Existing computational methods typically characterize eye-movements using discrete gaze trajectories and fixation events, yielding representations dominated by short-range temporal dynamics and limiting models that primarily emphasize long-range dependencies. Meanwhile, gaze behavior is naturally organized across semantically meaningful Areas of Interest (AOIs), whose attention allocation and transitions provide important structural cues, yet their relationships are rarely modeled explicitly. To address these limitations, we propose a structural face AOI-guided Eye-Gaze Track Network (AOI-Net) that jointly models short-term temporal dynamics and AOI-level structural organization. A network gating mechanism adaptively integrates the complementary temporal and structural representations according to their contributions to gaze-behavior characterization. To mitigate the pronounced class imbalance commonly encountered between individuals with ASD and Typically Developing (TD) participants in clinical datasets, class-distribution-aware learning is further employed to facilitate discriminative embedding learning under skewed class distributions. Experiments on a unique and large-scale clinical eye-tracking database comprising eight stimulus subsets and more than 1,300 participants show that AOI-Net consistently outperforms state-of-the-art methods. The proposed framework also enables interpretable gaze-behavior modeling and provides a practical basis for scalable AI-driven ASD screening in real-world healthcare. The code is available at https://github.com/Zhanpei-ai/CIM-AOI-Net/tree/main/Code
Joint attention (JA) is a core mechanism of social interaction, supporting coordination, knowledge transmission and early language development; deficits in JA are also a key early indicator of autism. While prior computer vision work often operationalizes JA as frame-based co-attention to a shared target, cognitive sci...
M. Dickerman, Michael Villamizar, Sabine Stoll et al.· Proceedings of the 28th Inte...· 0 citations
The term broad autism phenotype (BAP) refers to individuals who do not meet the diagnostic criteria for autism but share some of its features, including social difficulties and atypicalities in visual perception and attention that have been linked to a detail-oriented cognitive style. To examine both the cognitive and...
E. Gavrilova, Anna Izmalkova, Ksenia Novoselova et al.· Психология Журнал Высшей шко...· 0 citations
Here we present the Active Visual Semantics (AVS) dataset, a large-scale collection of magnetoencephalography (MEG) and eye-tracking data recorded while five participants freely explored 4,080 natural scenes over 10 sessions each, yielding more than 200,000 fixation epochs in total. Unlike existing neuroimaging dataset...
Philip Sulewski, Carmen Amme, P. König et al.· 0 citations
Experimental evaluation on the proposed multi-head Attention-driven Multimodal Feature Integration Network framework demonstrates that the proposed MAtMFIN framework consistently outperforms state-of-the-art transfer learning and Deep Learning models, including a hybrid Convolutional Neural Network (CNN)-Long Short-Ter...
A. R., Radha Senthilkumar· Discover Artificial Intellig...· 0 citations
Known for his clear and elegant writing style, Bertsekas shaped fields from control and optimization to large-scale computation and artificial intelligence.