Skip to content
Log in
Open access

Improving Arabic clinical question quality through domain-adaptive masked language modeling

Walid Ounachad M. Khenchouch Imad Zeroual Yousef Farhaoui
Jul 2026 · Language Resources and Evaluation · Vol 60 · 0 citations · 22 references
Computer Science

TL;DR

Overall, the proposed reformulation module produces more natural and clinically relevant Arabic questions and can be plugged into Arabic clinical QA pipelines as a measurable, tunable front-end.

Abstract

Arabic clinical NLP systems often receive short, vague, or incomplete questions, which yields weak downstream answers even with strong encoders. We address this bottleneck by making question quality a first-class and measurable objective. Using domain-adaptive (continued) pretraining with a masked-language objective (DAPT-MLM) on AHQAD (~ 808k Arabic health Q–A pairs), we adapt two widely used backbones—AraBERT and the generator variant of AraELECTRA—to the lexical, syntactic, and discourse patterns of well-formed medical questions. Evaluation is aligned with the learning signal: we report cross-entropy and perplexity only at masked tokens, top-k accuracy restricted to masked spans, and lexical-diversity measures to discourage formulaic phrasing. A length-controlled test design (Short/Long/Very Long) isolates modeling gains from verbosity. Results show consistent intrinsic improvements for the domain-adapted models; AraBERT-MLM is best overall (macro Top-5 = 0.8392, lowest CE/PPL), outperforming AraBERT (orig.) by + 6.0 pp Top-5 and AraELECTRA (orig.) by + 17.2 pp. A 200-item human study (clinician + linguist) corroborates these gains (mean ± 95% CI: Clarity 4.12 ± 0.18, Fluency 3.68 ± 0.22, Semantic Fidelity 3.15 ± 0.25, Usefulness 3.42 ± 0.21; substantial agreement, κ ≈ 0.77) and highlights residual semantic drifts that inform simple, slot-constrained decoding fixes. Overall, the proposed reformulation module produces more natural and clinically relevant Arabic questions and can be plugged into Arabic clinical QA pipelines as a measurable, tunable front-end.

DOI Semantic Scholar
Read PDF

Similar papers

#natural language process... Preprint Jul 2026

Bridging the English-Arabic Medical Knowledge Gap: Targeted Low-Rank Adaptation via Causal Layer Selection

It is shown that mechanistic diagnosis can serve as a practical guide for targeted adaptation in underrepresented-language medical LLMs, and Targeted Low-Rank Adaptation (TLoRA) is proposed, restricted to the layer window where cross-lingual representations diverge, upstream of the output layers where the failure manifests.

Chaimae Abouzahir, Musa Khan, Hala Ali-Hassan et al. · 0 citations
Open access Jul 2026

Question-Answer System on Medical Domain with LLMS Using Various Fine-Tuning & Rag with MCP Methods

Developing artificial intelligence capable of clinical language comprehension and reliable diagnostic reasoning has remained a core challenge in biomedical engineering. While Large Language Models (LLMs) demonstrate significant potential in general natural language processing tasks, their direct application in the medical domain is severely constrained by parametric hallucinations and data silos. This paper introduces an end-to-end, resource-efficient, multilingual speech-driven Question-Answering (QA) framework optimized for localized clinical support. To accommodate deployment on consumer-grade execution environments, we implement Parameter-Efficient Fine-Tuning (PEFT) using Low-Rank Adaptation (LoRA) and 4-bit Quantized LoRA (QLoRA) configurations across open-source 3B and 7B parameter architectures. Human preference alignment is enforced via a stateful Reinforcement Learning with Human Feedback (RLHF) loop applying Proximal Policy Optimization (PPO). Crucially, to mitigate the vulnerabilities of passive information retrieval, we introduce an Active Validation Loop powered by Corrective Retrieval-Augmented Generation (CRAG). This validation engine is decoupled from the model harness using the Model Context Protocol (MCP), standardizing asynchronous lookups across dense vector repositories, clinical guidelines, and real-time electronic health registries.

Misha Patel · 0 citations
Review Open access Aug 2026

SmartMM: A Domain-Specific Large Language Model for Medical Microbiology

Smart Medical Microbiology showed strong domain adaptability in medical microbiology knowledge organization, semantic generation, and retrieval-augmented reasoning, which supports its potential use in educational support, infectious disease knowledge assistance, and retrieval-enhanced medical question answering.

Yongqian Gong, Ruiqiang Ma, Xicheng Wang et al. · 0 citations
Open access Jul 2026

A Locally Executable AI System for Improving Preoperative Patient Communication: Multidomain Clinical Evaluation

By decoupling clinical information retrieval from generative chitchat, LENOHA enhances safety, preserves privacy, and markedly reduces energy use, offering a practical blueprint for sustainable and equitable medical AI deployment across diverse care settings.

Motoki Sato, Sou Nagata, Mizuho Ohnuma et al. · 0 citations
Preprint Aug 2026

A corpus-specific clinical RAG system matches or outperforms newer frontier LLMs on HealthBench

VITA's advantages in accuracy and completeness persisted under the neutral judge; its communication scores were lower, and this results indicate that a purpose-built clinical RAG system remains competitive with frontier LLMs on an open benchmark, consistent with corpus specificity as a design variable that improves grounding at some cost to communication polish.

Praveen Reddy, C. Mandke, Suvrankar Datta et al. · 0 citations