Oct 2026· International Conference on Robotics and Learning· Vol 14366, pp. 143660I - 143660I-7· 0 citations· 15 references
Engineering
TL;DR
Under split-before-windowing evaluation, the CNN-LSTM outperformed the evaluated single-modality and multimodal CNN, LSTM, and Transformer baselines while retaining a modest state-dictionary size of 1.037 MB.
Abstract
Hybrid surface electromyography (sEMG) and A-mode ultrasound (AUS) sensing can provide complementary information for hand gesture recognition. sEMG reflects electrical muscle activation, whereas AUS captures morphology-related tissue displacement. This study adapts a compact CNN-LSTM framework for recognizing nine hand gestures from synchronized sEMG and AUS recordings. The processed dataset used for the proposed model contains eight participants, four sEMG channels, four AUS channels, and 85,359 paired windows. Each window contains four AUS frames and temporally aligned sEMG samples, producing inputs of size [4, 4, 50] for sEMG and [4, 4, 128] for AUS. The model uses modality-specific convolutional frame encoders, two bidirectional LSTM branches, attention pooling, gated feature fusion, and a compact classifier. On an 80/20 per-subject per-gesture chronological split performed before overlapping-window generation, the model achieved 96.35% accuracy, 96.53% macro precision, 96.51% macro recall, and 96.50% macro F1-score with 271,411 trainable parameters. Under split-before-windowing evaluation, the CNN-LSTM outperformed the evaluated single-modality and multimodal CNN, LSTM, and Transformer baselines while retaining a modest state-dictionary size of 1.037 MB. Subject-independent and recording-held-out evaluation remains necessary before deployment claims can be made.
The proposed SE-MSCFormer offers an efficient and robust solution for low-sampling-rate sEMG gesture recognition and confirms that the synergy between the multi-scale temporal configuration and channel recalibration enhances overall recognition performance.
Chao Xian, Lei Liu, Bo Yang et al.· Conference on Advanced Algor...· 0 citations
Hand gesture recognition has emerged as an effective approach for enabling natural and contactless human–machine interaction (HMI). However, many existing vision-based approaches rely on computationally intensive image-based deep learning models or require specialized sensing hardware, limiting their deployment on low-...
Toqi Tahmid Khan, Ade Rukmana, W. Sediono· International Conference on...· 0 citations
Reliable hand gesture recognition plays an important role in human-computer interaction, prosthetic control, and rehabilitation systems. Surface electromyography (sEMG) has been widely used for gesture recognition because it directly captures muscle activity, whereas electroencephalography (EEG) provides complementary...
V. Manikandan, Shashank Mishra· 2026 7th International Confe...· 0 citations
Reliable hand gesture recognition is important for intelligent human–machine interaction, assistive technologies, and rehabilitation systems, where accurate interpretation of muscle-activation patterns is required. This study proposes an integrated explainable machine–deep learning framework for recognizing eight hand...
Yousif M. Al-Muslim, A. Jaber, Z. Khan· Engineer· 0 citations
A lightweight, cost-effective wearable gesture recognition system, evaluated on a 12-class constrained gesture vocabulary as a step toward scalable continuous SLR, integrating a custom sensorized glove with a parallel hybrid convolutional neural network (CNN)–long short-term memory (LSTM) architecture.
Muhammad Asim, Shan Zhou, Waga Arachchige Vishodha Charithani Waga Arachchi et al.· Measurement science and tech...· 0 citations
This work proposes MyoFlow, the first discriminative flow-matching framework for HD-sEMG recognition across sessions and subjects, which recasts classification as anchor-tied transport and moves encoded windows toward gesture anchors that serve as transport targets and define the nearest-anchor decision geometry, enabl...