Teleoperation as an Interaction Challenge: Lessons from Remote Operation of Heavy Machinery
TL;DR
The findings show that teleoperation should be designed as a distinct operating mode rather than as a replica of onboard driving, and effective teleoperation depends on inclusive workstation ergonomics, structured visual information, multimodal support for situational awareness and interface strategies suited to different levels of expertise.
Abstract
Teleoperation is increasingly relevant in heavy machinery because it can improve safety and enable work in hazardous environments. However, the main challenge is not only remote control, but remote perception. Operators must rely on camera views, displays, sensors, and interface logic to understand the machine and its surroundings, making HCI central to teleoperation design. This paper presents industry experiences from a remote operation project. Across ergonomic analysis, field observations, camera field of view simulation studies, video-based operator performance comparisons, participatory user studies and literature review, a consistent pattern emerged: operators learn controls relatively quickly but struggle with depth perception, spatial understanding and machine-environment interpretation through mediated interfaces. The findings show that teleoperation should be designed as a distinct operating mode rather than as a replica of onboard driving. Effective teleoperation depends on inclusive workstation ergonomics, structured visual information, multimodal support for situational awareness and interface strategies suited to different levels of expertise.