Skip to content

Semantically enhanced eye-tracking controls in human-robot interaction: a comparison study.

Oct 2026 · Ergonomics · pp. 1-21 · 0 citations · 26 references
Medicine

TL;DR

Findings of a within-subjects experiment with three control modalities suggest an association between attention-control channel coupling and cognitive resource allocation in semantically enhanced human-robot interaction, informing ergonomic hands-free interface design.

Abstract

Operators controlling robotic systems for sequential manipulation tasks present cognitive loads that vary with how they specify intent to the robot. Limited evidence exists on how semantically mediated voice and gaze interfaces differ in operator performance, visual attention, and perceived workload. This study presents findings of a within-subjects experiment (N = 30) with three control modalities (hand gesture, voice, and eye-tracking). Eye-tracking produced shorter, more consistent completion times (M = 17.10 s, SD = 3.95), indicating stable and efficient performance. Voice Control was associated with more structured but variable action ordering and higher NASA-TLX Mental Demand and Effort scores, consistent with demands from spatial-to-verbal intention translation. Gaze metrics indicated distinct attentional strategies: eye-tracking showed lower spatial entropy and fewer fixations, while voice control exhibited broader workspace scanning. These findings suggest an association between attention-control channel coupling and cognitive resource allocation in semantically enhanced human-robot interaction, informing ergonomic hands-free interface design.

View source

Similar papers

Open access Sep 2026

Measuring the dynamics of attentional capture in hand and eye movements with virtual reality

Laboratory investigations of attentional capture typically use two-dimensional displays and button-press responses, which may limit their generalizability to everyday experiences. The current study used a virtual reality (VR) system to measure the dynamics of attentional capture by simultaneously recording participants...

Max D. Gurr, Jeff Moher, M. Egbert et al. · 0 citations
Open access Oct 2026

Combined eye tracking and electroencephalography during referential selection in dyadic interaction

Understanding language in real-world interaction requires methods that integrate auditory, visual, and neural signals. We present a proof-of-concept study combining mobile electroencephalography (EEG) and eye tracking to investigate referential selection during dyadic communication. Using a simplified version of the di...

Ingmar Brilmayer, Philip Georgis, P. Schumacher · 1 citation
Open access 2025

EYECON: A MULTIMODAL HUMAN-COMPUTER INTERFACE INTEGRATING GAZE TRACKING AND VOICE COMMANDS

Human-Computer Interaction (HCI) continues to evolve towards more intuitive and accessible control paradigms, particularly for users with motor impairments. This paper presents EyeCon, a novel multimodal interface that synergizes real-time eye tracking with robust voice recognition to provide a hands-free method for sy...

Suyash Narawade, Shailesh Kadam, Sadik Pathan et al. · 0 citations
Open access Sep 2026

Perceptual Features of Arithmetic Expressions Bias Visual Attention: An Online Eye‐Tracking Study

While presenting perceptual cues (e.g., spatial proximity or color) in arithmetic expressions can affect participants' problem‐solving performance, the attentional mechanism underpinning these perceptual cues remains unclear. The current study examined how the presence of color and spacing cues (congruent, neutral, i...

Zelda Ferris, Pu-Yuan Zhang, Zi-Rui Zhong et al. · 0 citations
Open access Nov 2026

Assessing the attentional dynamics of Responding to Joint Attention in infancy via online webcam-based eye-tracking

Responding to Joint Attention (RJA) is a foundational social-cognitive skill that unfolds through a sequence of distinct attentional processes: engagement with a social partner, orienting toward a referent, and sustained attention to a shared point of interest. Traditional assessments of joint attention often rely on...

Roberta Bettoni, Giulia Calignano, E. Salomone et al. · 0 citations
Open access Sep 2026

Predictions and goals modulate use of partner's gaze during joint action with humanoid robots

During joint actions, partners coordinate attention and actions by using each other's gaze to predict upcoming actions and align with shared goals. Although gaze orienting has been extensively studied using screen-based paradigms, it remains unclear whether partner reliability and action goals calibrate the use of the...

J. Pérez-Osorio, E. Wiese, A. Abubshait et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.