Skip to content
Open access

Driver Drowsiness Prediction Using CNN-LSTM Model Based on Facial Expression and Eye Movement

Aug 2026 · ARMADA : Jurnal Penelitian Multidisiplin · Vol 4, pp. 3889-3903 · 0 citations

TL;DR

This comprehensive investigation introduces an adaptive, multi-task deep learning architecture merging Convolutional Neural Networks and Long Short-Term Memory configurations to dynamically evaluate driver states through localized facial expressions and non-invasive ocular metrics.

Abstract

Driver fatigue and drowsiness represent primary institutional catalysts for fatal highway traffic anomalies worldwide. This comprehensive investigation introduces an adaptive, multi-task deep learning architecture merging Convolutional Neural Networks and Long Short-Term Memory configurations to dynamically evaluate driver states through localized facial expressions and non-invasive ocular metrics. Utilizing MediaPipe FaceMesh, the framework maps 468 distinct landmark parameters under fluctuating illumination constraints to monitor regional variations across the eyes and mouth. The quantitative metrics are extracted by formulating real-time computations of the Eye Aspect Ratio and Mouth Aspect Ratio. Spatiotemporal feature representation is accomplished using a pre-trained ResNet50V2 feature extractor integrated with a 128-unit recurrent LSTM layer to process sequences across a 20-frame context window. The multi-branch dense layer concurrently outputs predictive status conditions for drowsiness, yawning frequency, and categorical facial expressions. System validation metrics indicate an overall classification accuracy of 88% for structural drowsiness tracking and 90% for yawning anomalies. This system is a “proof of concept” designed to be implemented for drivers to reduce traffic accidents caused by driver fatigue.

Read PDF

Similar papers

Conference Sep 2026

Driver Drowsiness Detection Using Facial Analysis and Machine Learning Techniques

Driver drowsiness detection is an important safety task because fatigue-related impairment can reduce attention and reaction time before a driver becomes fully asleep. Vision-based systems are suitable for practical deployment because facial cues can be extracted using a camera without requiring wearable sensors. Howev...

Muhammad Shafwan Anis, N. Rusli, Chee-Kiang Lam et al. · 0 citations
Open access Sep 2026

A Subject-Independent Temporal Framework for Behavioural Eye-Based Driver Drowsiness Detection

Driver drowsiness detection systems are often evaluated using data partitions that may retain observations from the same individuals across training and testing, making their ability to generalise to unseen drivers difficult to assess. This study investigates behavioural eye-based drowsiness detection under strict subj...

Olusola O. Ajayi, A. Kurien, Karim Djouani et al. · 0 citations
Open access Aug 2026

Image Classification using DenseNet-121 Based on MediaPipe Face Mesh for Real-Time Drowsiness Detection

Findings indicate that the integration of MediaPipe Face Mesh and DenseNet-121 shows meaningful potential for real-time drowsiness monitoring, while also highlighting the importance of subject-independent evaluation and cross-domain generalization for reliable real-world deployment.

Raihan Ramadhan Hamzah, C. A. Sari, Eko Hari Rachmawanto et al. · 0 citations
Sep 2026

Emotionnet: A Deep Learning Framework for Real-Time Video-Based Facial Emotion Recognition

EmotionNet is a neural network that is used to recognize facial emotions in real-time and under dynamic and unconstrained conditions using videos. The suggested system combines both spatial features extraction and time modeling to ensure the capture of facial appearance and motion-based emotion features. A convoluted n...

Amit Rehapade · 0 citations
#artificial intelligence Preprint Oct 2026

Graph-Based Recognition of Simulated Train-Driver States From Facial and Upper-Body Keypoints

Driver fatigue poses a significant challenge to railway safety, with traditional systems like the dead-man switch offering limited and basic alertness checks. This study presents a vision-based monitoring system that relies solely on a single front-facing RGB camera and a graph neural network to classify simulated trai...

Olivia Nocentini, Marta Lagomarsino, Gokhan Solak et al. · 0 citations
Open access Oct 2026

Deep Learning Approach for Facial Expression Identification Using Hybrid CNN-LSTM Architecture with Attention Mechanism

-Facial emotion recognition (FER) has emerged as a critical area of research in computer vision and affective computing, with applications spanning healthcare, human-computer interaction, security, and education. This paper presents a hybrid deep learning framework combining Convolutional Neural Networks (CNNs) and Lon...

Garba Ibrahim A. D., G. Yusufu, N. Nathan · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.