Skip to content

Multimodal Attention-based Deep Learning for Emergency Triage with Electronic Health Records

Jul 2026 · arXiv.org · Vol abs/2607.16662 · 0 citations · 21 references
Computer Science

TL;DR

A multimodal deep learning architecture that can effectively handle both tabular and textual data is proposed and the potential of the proposed model in predicting triage decisions is demonstrated.

Abstract

Accurate emergency triage decision is critical to avoid clinical deterioration, morbidity, and mortality. Machine learning-based triage system involves acquiring the main presenting complaint in text form and assessing vital signs in numerical data, enabling an automated and efficient analysis of patient information for timely and accurate prioritization of medical attention. However, modelling the intricacies of both data types requires a comprehensive understanding of the temporal structure and dependencies within the data. Thus, the aim of this study is to propose a multimodal deep learning architecture that can effectively handle both tabular and textual data. Furthermore, the proposed model exploits self-attention to to capture both local and global relationships between the features. A dataset consisting of 11,102 triage data collected from emergency department of Hospital Universiti Sains Malaysia is used for model development and validation. The proposed model demonstrated an increase of 1.95% in accuracy, 2.49% in F1-score, and 1.41% in ROC AUC compared to the baseline model. The experimental results demonstrated the potential of the proposed model in predicting triage decisions.

View source

Similar papers

Open access Aug 2026

Multimodal Deep Attention Fusion of Longitudinal EHR and Diagnostic Imaging for Real-Time Sepsis and Deterioration Prediction in Critical Care

This work presents MedCross-Fusion, a novel multimodal deep learning framework that dynamically integrates irregular, longitudinal EHR time-series data with diagnostic chest radiography with robust, real-time risk stratification capable of reducing diagnostic latency in critical care settings.

N. Nishu, Nadia Binte · 0 citations
Open access Aug 2026

An Attention-Based Multi-Modal Network Framework for Cardiovascular Disease Detection and Grading

A novel Hierarchical Attention-based Representation learning with Multi-modal Network (HARM-Net) framework to grade the severity of CVD and the significance of each component and the specific contribution of cross-attention fusion to improved model performance for accurate, multimodal diagnosis of CVD is demonstrated.

S. Shwetha, Y. Manu · 0 citations
#artificial intelligence Preprint Aug 2026

Scalable Clinical Data Infrastructure and Comparative ML Evaluation for Hospitalisation Risk Prediction in Elderly Patients with Multiple Long-Term Conditions using CPRD

It is argued that LASSO, not the highest-discriminating model, is the model best suited to direct clinical deployment, and lessons for the machine learning and healthcare community regarding data infrastructure, model selection, and value of calibration and interpretability in high-stakes decision support are presented...

Asra Aslam, Volodymyr Chapman, M. O'Connell et al. · 0 citations
Open access Aug 2026

Chronic Disease Prediction Using Temporal Convolutional and Attention-Guided LSTM Networks

A novel deep ensemble learning framework that integrates Temporal Convolutional Networks (TCNs) and attention-guided Long Short-Term Memory (LSTM) networks for robust chronic disease prediction and contributes toward explainable and proactive healthcare decision-making is proposed.

T. Thamaraiselvan, K. Saravanan, S. Nithyanandam · 0 citations
Open access Sep 2026

A multimodal risk stratification model using deep learning and tabular data

A deep learning–based framework for the simultaneous prediction of CVD and stroke risks using tabular health data and the potential of interpretable deep learning models to support early, data-driven risk stratification of cardiovascular and stroke risks directly from cross-sectional tabular data is proposed.

Abdelrahman Alaa Sadik, M. M. Morsey, T. Nazmy et al. · 0 citations
Conference Aug 2026

A Multi-View Hybrid Deep Learning Framework for Interpretable Disease Prediction using Heterogeneous Electronic Health Records

Electronic Health Record (EHR) contains varied and diversified clinical data, including demographic data, laboratory measures, diagnosis histories, medication data and physiological observations. However, there remains the issue of effectively using such multimodal information for illness prediction because of the data...

P. B, Raveendrababu Vempati · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.