Skip to content

Enhancing Image-Text Alignment in Chest X-ray Datasets by Reducing External References via a Fine-Tuned Large Language Model Pipeline.

Aug 2026 · Journal of imaging informatics in medicine · 0 citations · 10 references
Medicine

TL;DR

An automated, data quality-oriented preprocessing pipeline that rewrites radiology reports at the sentence level to reduce external references is developed and can serve as an effective preprocessing step for improving the suitability of chest X-ray report datasets for multimodal model development.

View source

Similar papers

Open access Sep 2026

Automated chest X-ray disease screening using large language models and deep convolutional neural networks on the MIMIC-CXR dataset

It is demonstrated that LLMs can be effectively employed to generate supervision labels for medical imaging tasks and that the proposed approach offers a scalable and low-cost solution for preliminary disease screening, particularly in healthcare environments with limited expert availability.

Qing-Yuan Zhang, Pardeep Vasudev, Kezhi Li et al. · 0 citations
Open access Sep 2026

A framework for extraction of clinical information from radiological mammography reports using large language models and retrieval augmented generation

A structured Retrieval-Augmented Generation (RAG) framework that leverages annotated mammography reports as in-context demonstrations, enabling joint named entity and relation extraction without task-specific fine-tuning is proposed and achieves performance comparable to fine-tuned BETO models in low-resource settings,...

Eduardo Godoy, J. De Ferrari, Sofia Lazo et al. · 1 citation · ⚡1
Sep 2026

Comorbidity-Aware Radiology Report Generation.

Chest X-ray report generation systems are valuable for assisting disease diagnosis and improving healthcare efficiency. However, existing methods still face two key challenges. First, multiple diseases often co-occur, leading to a combinatorial explosion of label combinations and sparse supervision for learning a gener...

Hong-Ze Zhu, Hong Liu, Ya-Wen Huang et al. · 0 citations
Open access Sep 2026

Dual-branch cross-modal architecture with global-to-local feedback for radiographic image–text retrieval in chest X-rays

Through hierarchical gated co-attention, this approach dynamically aligns image and text representations, addressing the limitations of static fusion and providing a foundation for interpretable, real-time retrieval systems that can accelerate and improve clinical decision support.

Rezaul Abedin, Sofiane Laridi, Kam-Ming Mark Tam · 0 citations
Preprint Aug 2026

HarMoE: Multi-Source Chest Radiograph Pretraining with Dataset-Disentangled Experts

This work proposes HarMoE, a dataset-aware mixture-of-experts framework that learns shared cross-dataset medical semantics while confining source-specific variation to lightweight residual experts in deeper decoder layers, and trains in a unified disease vocabulary with masked multi-dataset supervision, enabling the mo...

Haozhe Luo, Zi-Yu Zhou, Shelley Zixin Shu et al. · 0 citations
Dataset Open access Aug 2026

PatchChestCT: A patch-level spatial annotation dataset for nine abnormalities in chest CT

This work introduces a token-aligned annotation scheme that is efficient, scalable, and naturally integrates with modern deep learning architectures like Transformers, and shows that models trained with this scheme achieved higher localization performance than weakly supervised baselines trained on image-level labels a...

Yingtai Li, Hong-Chun Zhang, Meng-Yao Xu et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.