Active and Remote Visual-Tactile Human-Machine Interface Based on Self-Recoverable NIR Mechanoluminescence.

Abstract

Visual-tactile sensing offers a powerful strategy for high-resolution force detection in human-machine interfaces (HMIs), yet its deployment in space-constrained environments is often hindered by requirements for auxiliary illumination and complex electronics. The active and remote sensing modalities using mechanoluminescence (ML) materials offer an effective solution, though the realization of a self-recoverable, deep-tissue-penetrating system remains a challenge. Here, we report an active and remote visual-tactile HMI based on Ca5Ga6O14:Nd3+, a self-recoverable near-infrared (NIR) ML material. We identify piezoelectricity as the key factor driving the self-recovery process, which, combined with the intense NIR emission, enables the operation without external power or pre-irradiation. These intrinsic properties facilitate exceptional performance, including centimeter-scale deep-tissue penetration, high cyclic stability, and long-term durability. We further demonstrate an HMI-driven control system that effectively transduces biomechanical forces into real-time, multi-directional vehicle driving commands. By bridging the gap between material fabrication and system design, this work establishes a versatile paradigm for non-invasive, active visual-tactile perception in next-generation HMIs and assistive technologies.