Skip to content

Diffusion models for eye-gaze trajectory generation using position and velocity representations

Sep 2026 · 0 citations · 49 references
Computer Science

TL;DR

Overall, unconditional diffusion captures local gaze kinematics and short-range temporal and directional structure, while long-range properties such as saccade counts and cumulative path geometry remain targets for future conditioned models.

Abstract

Eye-tracking data are expensive to collect, requiring specialized hardware and controlled laboratory conditions, and difficult to share because of privacy constraints. We address this using two complementary denoising diffusion probabilistic models (DDPMs) for unconditional generation of eye-gaze dynamics from visual-search data. Both use an identical FiLM-conditioned one-dimensional U-Net with self-attention (19.35,M parameters), trained on 8,s sliding-window sequences from 28 participants. One model generates raw two-dimensional gaze-position sequences, while the other generates two-component velocity sequences; each uses representation-specific preprocessing, training settings, data partitions, and evaluation protocols. Both are evaluated across three independent training seeds, with aggregated metrics reported as mean,$\pm$,SD. The position-space model achieves a mean Jensen-Shannon (JS) divergence of $0.016\pm0.004$ across nine kinematic features, with the highest feature-wise mean below $0.030$, fixation duration within 2% of real data, and a Fr'echet Gaze Distance more than an order of magnitude below statistical and Markovian baselines. Under a Train-on-Synthetic-Test-on-Real protocol, synthetic-only training achieves $R^2=0.66\pm0.02$, or 82.7% of the real-data $R^2$ point estimate. The velocity-space model achieves a mean JS divergence of $0.0065$ across velocity components, speed, log-speed, and turning angle, with a maximum of $0.015\pm0.005$. Reconstructed path length is less accurate ($0.21\pm0.02$ versus $0.03\pm0.01$ in position space), although the protocols differ. Overall, unconditional diffusion captures local gaze kinematics and short-range temporal and directional structure, while long-range properties such as saccade counts and cumulative path geometry remain targets for future conditioned models.

View source

Similar papers

Preprint Aug 2026

Drift Calibration in Geometric Eye Tracking Systems

This work presents a calibration-focused dataset containing 163 trials from 12 participants, with separate 18-point fitting and 32-point test grids, and uses it to evaluate global, local, and composite correction functions under a common spatial-extrapolation protocol and introduces a lightweight neural refiner that co...

Jia-Qi Liu, Zi-Xuan Wang, Yu-Hong Zhang et al. · 0 citations
Preprint Sep 2026

GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning

GazeDiT is introduced, a diffusion model that generates images for a requested 4D gaze through an internally constructed spatial condition that grounds the global gaze label in this local geometry, and achieves substantially lower tail gaze-label error than other diffusion baselines.

Dong-Ze Wu, David Colmenares, Feng-Ting Yang et al. · 0 citations
#machine learning Preprint Oct 2026

EyeTAG: Eye Trajectory-Aware Gaze Estimation

Within-model ablations, which keep the encoder and the rest of the architecture fixed and vary only the gaze history, show that the differential formulation removes the systematic saccade bias that persists even with an absolute gaze-history prior.

Jungmin Lee, Niamat Ullah, Yoseob Han · 0 citations
#machine learning Preprint Sep 2026

GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction

Egocentric gaze prediction enables many downstream applications but remains challenging, as human gaze is inherently stochastic. This stochasticity is constrained by structured temporal dynamics alternating between fixations and saccades, top-down influences from tasks, and bottom-up visual saliency. Based on this obse...

Sheng Zhao, Wei-Kai Lin, Yu-Hao Zhu · 0 citations
Preprint Aug 2026

Motion-Based Tokenization for Cross-Dataset Egocentric Gaze Modeling

Motion-based tokenization provides a compact representation for event-aligned egocentric gaze streams, while the evaluation identifies how target predictability and event construction shape cross-dataset conclusions.

Virmarie Maquiling, Zhuojiang Cai, Enkelejda Kasneci · 0 citations
#computer vision Preprint Sep 2026

EyeMakeYou: Identity-, Task-, and Subjective-State-Conditioned Diffusion for High-Frequency Gaze Synthesis

Eye movement biometrics (EMB) is an emerging behavioral modality for user authentication, particularly in virtual- and augmented-reality systems, where gaze dynamics contain distinctive subject-specific features. However, robust EMB systems require diverse, high-quality gaze recordings that are expensive to collect and...

Kamrul Hasan, Mehedi Hasan Raju, Oleg V. Komogortsev · 1 citation

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.