Oct 2026· Ergonomics· pp.
1-21
· 0 citations· 26 references
Medicine
TL;DR
Findings of a within-subjects experiment with three control modalities suggest an association between attention-control channel coupling and cognitive resource allocation in semantically enhanced human-robot interaction, informing ergonomic hands-free interface design.
Abstract
Operators controlling robotic systems for sequential manipulation tasks present cognitive loads that vary with how they specify intent to the robot. Limited evidence exists on how semantically mediated voice and gaze interfaces differ in operator performance, visual attention, and perceived workload. This study presents findings of a within-subjects experiment (N = 30) with three control modalities (hand gesture, voice, and eye-tracking). Eye-tracking produced shorter, more consistent completion times (M = 17.10 s, SD = 3.95), indicating stable and efficient performance. Voice Control was associated with more structured but variable action ordering and higher NASA-TLX Mental Demand and Effort scores, consistent with demands from spatial-to-verbal intention translation. Gaze metrics indicated distinct attentional strategies: eye-tracking showed lower spatial entropy and fewer fixations, while voice control exhibited broader workspace scanning. These findings suggest an association between attention-control channel coupling and cognitive resource allocation in semantically enhanced human-robot interaction, informing ergonomic hands-free interface design.
Laboratory investigations of attentional capture typically use two-dimensional displays and button-press responses, which may limit their generalizability to everyday experiences. The current study used a virtual reality (VR) system to measure the dynamics of attentional capture by simultaneously recording participants...
Max D. Gurr, Jeff Moher, M. Egbert et al.· Behavior Research Methods· 0 citations
Understanding language in real-world interaction requires methods that integrate auditory, visual, and neural signals. We present a proof-of-concept study combining mobile electroencephalography (EEG) and eye tracking to investigate referential selection during dyadic communication. Using a simplified version of the di...
Ingmar Brilmayer, Philip Georgis, P. Schumacher· Behavior Research Methods· 1 citation
Human-Computer Interaction (HCI) continues to evolve towards more intuitive and accessible control paradigms, particularly for users with motor impairments. This paper presents EyeCon, a novel multimodal interface that synergizes real-time eye tracking with robust voice recognition to provide a hands-free method for sy...
Suyash Narawade, Shailesh Kadam, Sadik Pathan et al.· 0 citations
While presenting perceptual cues (e.g., spatial proximity or color) in arithmetic expressions can affect participants' problem‐solving performance, the attentional mechanism underpinning these perceptual cues remains unclear. The current study examined how the presence of color and spacing cues (congruent, neutral, i...
Zelda Ferris, Pu-Yuan Zhang, Zi-Rui Zhong et al.· Mind, Brain, and Education· 0 citations
Responding to Joint Attention (RJA) is a foundational social-cognitive skill that unfolds through a sequence of distinct attentional processes: engagement with a social partner, orienting toward a referent, and sustained attention to a shared point of interest. Traditional assessments of joint attention often rely on...
Roberta Bettoni, Giulia Calignano, E. Salomone et al.· Frontiers in Developmental P...· 0 citations
During joint actions, partners coordinate attention and actions by using each other's gaze to predict upcoming actions and align with shared goals. Although gaze orienting has been extensively studied using screen-based paradigms, it remains unclear whether partner reliability and action goals calibrate the use of the...
J. Pérez-Osorio, E. Wiese, A. Abubshait et al.· Acta Psychologica· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.