Skip to content
Open access

Assisting patients with reliable information gathering: A guide to building efficient QA systems for medical use

Sep 2026 · PLOS Digital Health · Vol 5 · 0 citations · 49 references
Medicine

TL;DR

This study introduces a novel methodology leveraging publicly accessible online health forums to systematically build an unbiased, privacy-conscious QA dataset, and it employs Topic-guided Semantic Modeling (TGSM) for automated topic identification, enabling efficient and targeted annotation of relevant patient-generated content.

Abstract

The application of question-answering (QA) systems in the medical domain has rapidly advanced, significantly improving patients’ access to reliable health-related information. However, current approaches face notable challenges, including the difficulty in obtaining large-scale and unbiased medical datasets, significant privacy concerns, and inefficiencies due to manual dataset annotation. To address these issues, This study introduce a novel methodology leveraging publicly accessible online health forums to systematically build an unbiased, privacy-conscious QA dataset, and it employs Topic-guided Semantic Modeling (TGSM) for automated topic identification, enabling efficient and targeted annotation of relevant patient-generated content. Subsequently, this study propose a two-stage QA pipeline based on a Retriever–Reader architecture, which is further enhanced through fine-tuning state-of-the-art transformer-based models on the constructed domain-specific QA dataset. Experimental results demonstrate that our fine-tuned BioBERT significantly outperforms existing benchmarks, offering accurate patient-derived insights and providing a replicable framework for building efficient medical QA systems.

Read PDF

Similar papers

Review Open access Oct 2024

Large Language Model Benchmarks in Medical Tasks

A comprehensive survey of various benchmark datasets used in medical LLM tasks, focusing on various aspects of medical knowledge such as electronic health records, doctor–patient dialogues, medical question answering, and medical image captioning, is presented.

L. K. Yan, Qian Niu, Ming Li et al. · 34 citations · ⚡1
#artificial intelligence Conference Open access Oct 2026

SAGE: Semantic Anchor-Guided Evolution for Grounded Medical QA Data Synthesis

Extensive experiments across multiple medical question-answering benchmarks demonstrate that models fine-tuned with SAGE-synthesized data consistently outperform those trained using self-derived or conventional document-based paradigms, highlighting tangible improvements in data efficiency and resource utilization for...

Chuan Li, Chengyu Wang, Cen Chen et al. · 0 citations
Open access Sep 2026

Information retrieval in pre-hospital care with visualization-oriented natural-language interface via LLMs

A novel framework that leverages the language understanding and code generation ability of Large Language Models (LLMs) to build an information retrieval system with Visualization-oriented Natural-language-based Inter-faces (V-NLI).

Xin Gao, Zheng-Ye Zhu, Xin-Yu Ma et al. · 0 citations
Sep 2026

A Living Benchmark for Information Retrieval from Electronic Health Records

A scalable framework that automatically generates question--answer pairs from longitudinal EHR notes that supports evaluations that static benchmarks cannot, including the generation of multiple answers that reflect variation in clinician reasoning for robust performance assessment and continuously refreshing benchmark...

J. Cahoon, C. Stanwyck, Sulaiman Somani et al. · 1 citation
Review

The Application of Large Language Models in Medical Question‑Answering Robots

This review explores the transformative impact of Large Language Models on medical question-answering robots and addresses critical challenges faced by LLM-driven systems, such as limited interpretability, restricted applicability across medical domains, and serious concerns about patient privacy.

Zhao-Xu Wang · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.