CM-FuseNet: An Attention-Augmented Hybrid EEG–EMG Cognitive–Motor Fusion Network with Soft Actor-Critic Reinforcement Learning for Adaptive Lower-Limb Exoskeleton Control
TL;DR
CM-FuseNet is presented, an attention-augmented hybrid Brain–Computer–Muscle Interface that simultaneously fuses cortical concentration indices extracted from electroencephalography (EEG) and lower-limb intention patterns derived from electromyography (EMG) to adaptively control a 4-DOF assistive lower-limb exoskeleton.
Abstract
Population aging and the rising prevalence of motor disorders are driving demand for assistive lower-limb robotic systems capable of decoding user intention rather than merely providing mechanical support. We present CM-FuseNet, an attention-augmented hybrid Brain–Computer–Muscle Interface (BCMI) that simultaneously fuses cortical concentration indices extracted from electroencephalography (EEG) and lower-limb intention patterns derived from electromyography (EMG) to adaptively control a 4-DOF assistive lower-limb exoskeleton. To eliminate the burden of human-subject ethics review and to ensure reproducibility of the proposed methodology, all validation is performed exclusively on (i) permissively licensed open-access biomedical datasets, (ii) high-fidelity OpenSim 4.5 and MuJoCo 3.1 musculoskeletal–exoskeleton co-simulation, and (iii) limited self-experimentation by the corresponding author with non-invasive consumer-grade devices. Three components are introduced: (i) a log-tanh normalized concentration index CI in (0, 1) derived from the (PSMR+PMid−Beta)/PTheta ratio; (ii) a bidirectional Cross-Modal Transformer (CMT) with eight-head self- and cross-attention; and (iii) a Soft Actor-Critic (SAC) reinforcement-learning controller that adaptively tunes four servo PID gains using a concentration-weighted state. Experiments on the PhysioNet EEGMMIDB, Ninapro DB2/DB7, HuMoD and WAY-EEG-GAL datasets (combining N = 162 trial sessions, 47,520 windows, and five-fold cross-validation) yield a gait-phase classification accuracy of 96.84 ± 1.18%, torque-tracking RMSE of 0.072 ± 0.008 N·m, information transfer rate of 38.6 bits/min, end-to-end latency of 9.4 ms, and a 27.4% reduction in simulated metabolic cost over an EMG-only PID baseline (one-way ANOVA: F(4, 75) = 47.83, p < 0.001; Tukey HSD: p < 0.01 against all baselines). Under high cognitive load, CM-FuseNet preserves accuracy with only a 4.63 percentage-point degradation versus 13.22 percentage points for the EMG-only baseline.