The proposed methodology selects and preprocesses a large corpus of scientific articles on malaria, and then annotates them with entities of clinical significance, and leverages BioBERT, a state-of-the-art pre-trained language model, to encode the textual data into context-aware representations.
Abstract
Malaria remains a significant global health burden, necessitating continuous research efforts to understand its complex molecular mechanisms, epidemiology, and potential therapeutic interventions. Extracting essential biomedical information from the vast and constantly growing malaria literature is a challenging task that demands innovative approaches. Recently, pre-trained language models have revolutionized natural language processing tasks, demonstrating remarkable capabilities in various domains. This paper proposes a fine-tuned pre-trained biomedical language model for biomedical information extraction from scientific literature on malaria disease. The proposed methodology selects and preprocesses a large corpus of scientific articles on malaria, and then annotates them with entities of clinical significance. It then leverages BioBERT, a state-of-the-art pre-trained language model, to encode the textual data into context-aware representations. We fine-tune the model using domain-specific annotations and supervised learning to enhance its ability to extract relevant biomedical named entities. Extensive experiments and comparisons with different encoding and machine learning algorithms show that the proposed approach significantly outperforms them in precision, recall, and accuracy. We also publish our human-labeled dataset for entity and relation extraction to enable other health informatics researchers to train advanced models for malaria information extraction.
The results show where domain specialization and lightweight adaptation offer practical value, and where transformer accuracy justifies higher inference costs, providing an empirical basis for building knowledge systems under resource constraints.
Genis Skura, A. Geissbühler, Jean-Luc Falcone· 0 citations
This work presents a scalable, reproducible framework for evaluating, optimizing, and interpreting LLMs for biomedical knowledge extraction, with a focus on gene–gene regulatory relation prediction, pathway component recognition, multimodal pathway figure understanding, and automated prompt optimization.
While domain-specific Large Language Models (LLMs) have encoded vast biomedical knowledge, their limited context windows often hinder a deep understanding of nuanced relationships within and across texts. To address this limitation, we introduce BioBigBird, a bidirectional language model pre-trained on extensive biomed...
Roshan Balaji, S. Pavan Kumar, Vasudev Gupta et al.· 0 citations
Findings indicate that integrating topic modeling– based thematic information with PLMs provides an effective, generalizable, and practical solution for biomedical MLTC tasks, and enriching general-purpose language models with topic information offers a promising alternative that reduces reliance on costly, data-intens...
The proposed AGPNer integrates a heterogeneous dependency fusion encoder, which reconstructs masked entities to enhance token representations and fine-tunes a hybrid dependency modeling block to learn domain-specific patterns in medical texts; an imbalance-adaptive span decoder, which decouples entity and non-entity sp...
Yu-Ling Li, Yang-Juan Hu, Yi-Ming Bao et al.· ACM Transactions on Intellig...· 0 citations