MyoCardBench is the largest real-world, multi-task benchmark developed specifically for LLM evaluation across the cardiovascular care continuum and provides the broadest coverage of clinically authentic cardiology scenarios reported to date.
The benefits of multimodal data integration are task-dependent and healthcare LLMs should examine clinical data modalities according to specific tasks for efficient integration, and provide practical guidance for designing efficient clinical decision support systems.
Cheng Peng, Mengxian Lyu, Ziyi Chen et al.· JAMIA Journal of the America...· 0 citations
MMTClinic is presented, a benchmark designed to evaluate large language models (LLMs) on complex reasoning and question-answering tasks involving clinical time-series and reveals notable differences in model performance across tasks, languages, and modalities, highlighting current limitations in clinical reasoning capa...
Sourav Malakar, Harshit Nigam, Akash Ghosh et al.· 0 citations
CoMedBench is introduced, a reproducible benchmark that evaluates a family of generators under a common clinical-validity framework and one shared training and evaluation engine, spanning static tabular and temporal downstream tasks on established critical-care datasets.
Akanta Das, Farhad Al-Amin Dipto, M. S. Anto et al.· 0 citations
A comprehensive survey of various benchmark datasets used in medical LLM tasks, focusing on various aspects of medical knowledge such as electronic health records, doctor–patient dialogues, medical question answering, and medical image captioning, is presented.
L. K. Yan, Qian Niu, Ming Li et al.· Medicine Advances· 34 citations· ⚡1
This review clarifies the emerging role of LLMs in cardiovascular medicine and proposes a physician-supervised framework for safe multimodal clinical integration as a testable translational framework for combining specialized AI, multimodal models, evidence retrieval, and human clinical judgment.
P. Mitrović· Journal of Clinical and Tran...· 0 citations
This work introduces MedReaMM, a benchmark specifically designed to evaluate models'ability to synthesize heterogeneous clinical evidence consisting of detailed patient histories alongside multiple medical images into accurate differential diagnoses under a complete-information paradigm.
Lai Wei, Yu-Chao Chen, Zhenbiao Cao et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.