Skip to content

Category

federated learning

367 papers

#large language models Open access Sep 2026

Multimodal medical diagnosis: a mini review of LLM–vision fusion models in low-resource healthcare settings

Recent advances in large language models (LLMs) and vision transformers have enabled multimodal systems that integrate clinical text with medical imaging for diagnostic decision-making. While these systems show promising results on benchmark datasets in well-resourced research settings, their applicability in low-resource healthcare environments where diagnostic disparities are most severe remains limited and poorly understood. This mini review synthesizes key developments in LLM–vision fusion architectures from 2018 to 2026, with a focus on radiology-oriented visual question answering (VQA) and report generation systems viewed from a deployment perspective. Rather than comprehensively cataloguing multimodal medical AI, we synthesize the evolution of LLM–vision fusion architectures and discuss complementary deployment-enabling strategies, including parameter-efficient adaptation, post-training quantization, federated learning, and multilingual support, where they directly improve the feasibility of radiology AI in resource-constrained healthcare settings. Rather than focusing solely on performance benchmarks, we examine these approaches through a deployment-oriented lens, highlighting trade-offs between representational capacity, computational efficiency, interpretability, and memory footprint. We argue that current progress remains substantially shaped by model scaling and benchmark optimization, which often do not address the memory, connectivity, and annotation constraints of low-resource healthcare systems. While cross-modal transformer architectures provide strong representational alignment, their computational demands and reliance on large curated datasets limit real-world deployment. In contrast, emerging directions including parameter-efficient fine-tuning, post-training quantization, federated learning, and modular agent-based systems offer more tractable pathways toward clinical integration under hardware and data constraints. To bridge the gap between benchmark performance and clinical utility, we identify concrete challenges in data scarcity, multilingual coverage, and calibration, and propose a shift toward lightweight, interpretable, and hardware-aware multimodal AI. This perspective highlights the need to move beyond scaling-centric design toward models that can run on 4–8 GB VRAM, operate offline, and generalize across languages and imaging equipment.

Kahakashan Ashraf, Md. Hamid Hosen, Nuzhat Tabassum Farah et al. · 0 citations
#artificial intelligence Open access Sep 2026

Decoding cancer with artificial intelligence: Transforming research, diagnosis, and therapy with future insights

Cancer remains one of the leading global health burdens, with increasing complexity in genomic, imaging, and clinical datasets presenting significant challenges for effective management. Artificial intelligence (AI) has emerged as a powerful tool to address these challenges by enabling pattern recognition, knowledge integration, and data-driven decision-making. This review highlights recent advances in the application of AI across cancer research, diagnosis, and therapy. In research, AI accelerates drug discovery and repurposing, enhances genomic data interpretation, and facilitates biomarker identification through multi-omics integration. In diagnosis, AI has demonstrated high technical performance in radiology for lesion detection and image segmentation, in pathology for tumour grading and molecular prediction, and in liquid biopsy for non-invasive biomarker analysis. In therapy, AI supports precision medicine by predicting treatment responses, monitoring disease progression, and optimizing clinical trial design. Despite these advances, barriers such as data heterogeneity, algorithmic bias, interpretability, and regulatory challenges remain. Future directions, including explainable AI, federated learning, multimodal modelling, and digital twins, hold promise for translating AI-driven innovations into routine oncology practice. Significance Statement This review provides a timely synthesis of recent (2020–2025) advances in artificial intelligence across cancer research, diagnosis, and therapy, highlighting applications in drug discovery, genomics, multi-omics biomarker identification, and clinical decision-making. By integrating technological progress with translational and clinical relevance, this work serves as a valuable resource for bridging AI innovation with precision oncology practice. As a narrative review, the literature was identified through targeted PubMed, Scopus, and Google Scholar searches, combining terms for artificial intelligence, machine learning, and deep learning with cancer-related keywords, with priority given to peer-reviewed studies published between 2020 and 2025, seminal earlier works, and official regulatory or guideline documents. Within each domain, representative studies were selected to illustrate methodological diversity, clinical context, and current translational readiness rather than to provide exhaustive coverage of an extremely rapidly evolving field.

Muneera Anwer, Krupa Bhaliya, Ming Q. Wei · 0 citations
#federated learning Review Sep 2026

The Rise of Artificial Intelligence in Oncology: Opportunities, Challenges, and Future Directions

Overall, AI is becoming an integral component of modern oncology, particularly radiation oncology, and its successful integration into routine clinical practice will require robust validation, transparent governance, equitable implementation, and continued clinician oversight to ensure safe, effective, and patient-centred cancer care.

K. Rastogi · 0 citations

LumiCharge: Spherical Harmonic Convolutional Networks for Atomic Charge Prediction in Drug Discovery.

Atomic charge is crucial in drug design for analyzing reactive sites and interactions between ligands and targets. While quantum mechanical methods offer high accuracy, they are generally computationally costly. Conversely, empirical approaches, while computationally efficient, frequently suffer from lack of precision and generalizability. Recent a number of machine learning-based models have been developed for atomic charge predictions, but they struggle with accurately representing molecular structures and capturing the chemical environments affecting atomic charges, thus limiting their generalization and accuracy. To overcome these limitations, we propose LumiCharge, a novel atomic charge prediction framework that incorporates high-order spherical harmonics convolutions and explicitly models multibody interactions. In constructing this model, we employ a strategy that integrates both high- and low-order information, enhancing its geometric spatial perception capability, which is currently underexplored in the field. Benchmark evaluations demonstrate that LumiCharge outperforms state-of-the-art (SOTA) models by 30%-60% across diverse data sets. Additionally, in cross-scale experiments, LumiCharge demonstrates exceptional extrapolation capability and robustness across molecules of varying sizes, effectively overcoming the limitations imposed by molecular sizes. On an external halogen-containing test set, LumiCharge achieves an RMSE of 0.055e, meeting practical application requirements. Finally, a case study of virtual screening for the androgen receptor (AR) target further validates its outstanding accuracy compared to the OPLS3e force field and other deep learning (DL)-based baseline models, highlighting its exceptional generalization capacity and practical utility in real-world scenarios.

Qun Su, Hui Zhang, Qiaolin Gou et al. · 2 citations

PepBAN: A Deep Learning Framework with Bilinear Attention and Adversarial Learning for Peptide-Protein Interaction Prediction

Accurate prediction of the peptide-protein interaction (PepPI) is crucial for developing peptide-based therapeutics and vaccines. However, this computational task has traditionally faced significant challenges, such as the scarcity of structure data along with the corresponding label of the binding affinity for bound complexes. To address these challenges, we introduce PepBAN, a deep learning framework for modeling PepPI predictions. PepBAN incorporates two technical advancements: (1) adopting the protein language model ESM-2 to characterize proteins and ESM-2 or a graph-based foundation model for peptides without structure data and (2) leveraging the conditional domain adversarial learning to enhance generalization across a broad range of protein targets, especially when there are limited binding data. At the core of PepBAN is a bilinear attention network (BAN) that effectively learns the pattern of pairwise local interactions, enables the identification of key residues participating in the peptide-protein interactions, and offers an intuitive approach to interpret the underlying mechanisms of PepPIs via analyzing attention weights. Our numerical experiments demonstrated that PepBAN outperformed the previous state-of-the-art models across several well-established benchmark studies. Furthermore, we evaluated PepBAN's applicability in predicting cyclic peptide-protein interactions, a task that poses significant challenges due to the presence of noncanonical amino acids. These nonstandard residues require specialized handling, which most existing sequence-based PepPI prediction models did not adequately address, and we adopt an atom-resolved molecular graph approach to process cyclic peptides. Despite this complexity, PepBAN demonstrated a clear advantage by achieving a superior prediction performance and offering a distinct edge in tackling the emerging chemical space of cyclic peptides, which has great potential for novel therapeutic development. In summary, PepBAN serves as a valuable tool for advancing peptide-based drug and therapeutic development.

Shuaiyan Li, Xiaorui Wang, Yuchen Zhu et al. · 2 citations

ChargeNet: E(3) Equivariant Graph Attention Network for Atomic Charge Prediction

Atomic charge is a fundamental quantum chemical property essential for advancing drug design and discovery. Although quantum mechanics (QM) methods offer the highest level of accuracy, their computational demands scale quadratically with the number of atoms, limiting their practicality for large-scale applications. In light of this, empirical and semiempirical methods have been introduced to improve computational efficiency, albeit often at the expense of accuracy. The advent of artificial intelligence has witnessed a growing application of machine learning (ML) techniques to accelerate atomic charge predictions. However, existing ML models often suffer from low accuracy and limited generalization capabilities. To address these challenges, we introduce an advanced equivariant graph attention neural network specifically engineered to model long-range atomic electrostatic interactions with high precision. This model introduces a sophisticated global graph attention mechanism, enabling it to capture charge contributions across multiple scales. By utilizing a combination of structural symmetry-preserving transformations and multiscale attention, our approach not only preserves the inherent symmetries of molecular structures but also substantially improves the model's accuracy, generalization, and robustness in complex scenarios. Our empirical analyses demonstrate that, compared to leading baseline models, the proposed model improves charge prediction accuracy by over 40% on average across various charge-calculation schemes. Remarkably, the model achieves superior performance on the external RESP (restrained electrostatic potential) test data sets, with a 54.6% improvement over the baseline. Additionally, we evaluated our charge model under the setting of virtual screening, where it outperforms both the OPLS3 charges and baseline deep learning models across all evaluation metrics, highlighting its extensive potential for scientific discovery.

Qiaolin Gou, Qun Su, Jike Wang et al. · 1 citation

PepPCBench is a Comprehensive Benchmarking Framework for Protein-Peptide Complex Structure Prediction

Accurate modeling of protein-peptide interactions is essential for understanding fundamental biological processes and designing peptide-based drugs. However, predicting the complex structures of these interactions remains challenging, primarily due to the high conformational flexibility of peptides. To support a fair and systematic evaluation of recent deep learning (DL) approaches, we introduce PepPCBench, a benchmarking framework tailored to assess protein folding neural networks (PFNNs) in protein-peptide complex prediction. As part of this framework, we curated PepPCSet, a data set of 261 experimentally resolved complexes with peptides ranging from 5 to 30 residues. We benchmark five full-atom PFNNs, including AlphaFold3 (AF3), AlphaFold-Multimer (AFM), Chai-1, HelixFold3 (HF3), and RoseTTAFold-All-Atom (RFAA), using comprehensive evaluation metrics. Our benchmarking reveals meaningful performance differences among these methods and highlights the influence of peptide length, conformational flexibility, and training set similarity on prediction accuracy. While AF3 shows strong performance in structure prediction, further analysis indicates that confidence metrics correlate poorly with experimental binding affinities, underscoring the need for improved scoring strategies and generalizability. By providing a reproducible and extensible framework, PepPCBench enables a robust evaluation of PFNN-based methods and supports their continued development for peptide-protein structure prediction.

Silong Zhai, Huifeng Zhao, Jike Wang et al. · 13 citations · ⚡1

CarsiDock-Cov: A deep learning-guided approach for automated covalent docking and screening

The interest in covalent drugs has resurged in recent decades, spurring the development of numerous specialized computational docking tools to facilitate covalent ligand design and screening. Herein, we present CarsiDock-Cov, a new paradigm distinguishing itself as the first deep learning (DL)-guided approach for covalent docking. CarsiDock-Cov retains the core components of its non-covalent predecessor, leveraging a DL model pretrained on millions of docking complexes to predict protein–ligand distance matrices, along with a dedicated-designed geometric optimization procedure to convert these distances into refined binding poses. Additionally, it incorporates several key enhancements specifically tailored to optimize the protocol for covalent docking applications. Our approach has been extensively validated on multiple public datasets regarding the docking and screening of covalent ligands, and the results indicate that our approach not only achieves comparably improved applicability compared to its non-covalent predecessor, but also exhibits competitive performance against various state-of-the-art covalent docking tools. Collectively, our approach represents a significant advance in covalent docking methodology, offering an automated and efficient solution that shows considerable promise for accelerating covalent drug discovery and design.

Chao Shen, Hongyan Du, Xujun Zhang et al. · 12 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Aug 27, 2026

Looking beyond natural sequences

A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.