AdaFusion is presented, a lightweight adaptive fusion framework that integrates complementary signals from multiple frozen PFMs through low-dimensional feature compression and a sample-conditioned gating module that reweights model-wise (and optionally channel-wise) contributions.
Abstract
Pathology foundation models (PFMs) provide strong tile-level representations via self-supervised pre-training on large-scale pathology images. Yet, PFMs are developed under diverse and often opaque data, architecture, and objective choices, inducing latent representational biases that limit robustness and obscure what each model specialises in. We present AdaFusion, a lightweight adaptive fusion framework that integrates complementary signals from multiple frozen PFMs through (1) low-dimensional feature compression and (2) a sample-conditioned gating module that reweights model-wise (and optionally channel-wise) contributions. Beyond improving predictive accuracy, AdaFusion provides contribution-driven interpretation that offers evidence consistent with model-specific preferences and synergistic interactions across tissue phenotypes. We evaluate AdaFusion on three public benchmarks spanning treatment response prediction, prostate cancer grading, and spatial gene expression inference. AdaFusion consistently outperforms individual PFMs and other fusion baselines, while providing interpretable tissue visualisation which aligns model preferences with morphological patterns. Code is available at: https://github.com/xyx-98/PathoOracle.
PRISM2 demonstrates how language-supervised pretraining provides a scalable, clinically grounded signal for generalizable pathology representations, bridging human diagnostic reasoning and foundation model performance.
E. Vorontsov, George Shaikovski, Adam Casson et al.· Nature Medicine· 2 citations
This work reports Pathway Activity Autoencoders for the multi-omics setting, which embed prior knowledge via pathway-informed architectural constraints, fostering interpretability, while preserving representational power, in the context of breast cancer.
Pedro Henrique da Costa Avelar, L. Ou-Yang, Min Wu et al.· 0 citations
Integrative modeling of metagenomic and clinical data can advance the study of host phenotypes, but remains challenged by cross-view heterogeneity, uncertain generalizability, and poor interpretability. We developed SAMECAT (Structure-Aware Metagenomics multi-viEw Contrastive AlignmenT), a structure-aware deep learning framework that integrates species-level shotgun metagenomic profiles with mixed-type clinical covariates through view-specific encoders, clustering-informed contrastive alignment, and adaptive representation fusion. Using two independent Louisiana Osteoporosis Study datasets generated through distinct sequencing and bioinformatics pipelines (development n = 1,990; external evaluation n = 481), we evaluated SAMECAT for bone mineral density prediction at four skeletal sites. SAMECAT consistently outperformed single-view models, naive concatenation, alternative deep learning integration approaches, and established machine learning baselines, with performance gains largely preserved in cross-pipeline external evaluation. To improve biological interpretability, we developed a stability-oriented interpretation workflow that aggregates individually low-magnitude and diffusely distributed feature attributions into structured modules, revealing reproducible site-dependent patterns, coherent functional themes, and representative hub taxa. SAMECAT thus provides a robust and interpretable framework for multi-view metagenomic modeling of microbiome-associated host phenotypes.
Hong-Wen Deng, Lindong Jiang, Martha I Gonzalez-Ramirez et al.· Research Square· 0 citations
Attention-based multiple instance learning (ABMIL) is the predominant approach for slide-level prediction in computational pathology, yet its attention maps provide only local explanations: they indicate where a model focuses but not which histological features drive its predictions or how the model behaves across a patient cohort. We present Semantic Attention Global Explanations (SAGE), a post-hoc framework that extracts global, language-grounded explanations from a frozen ABMIL model. Using a pathology vision-language model, SAGE scores image patches against a dictionary of 25 histological concepts, aggregates these scores according to the model's learned attention, and quantifies how each concept relates to prediction risk across a cohort. Applied to survival prediction using seven TCGA cancer cohorts and three foundation models, SAGE recovered established prognostic features, such as the adverse association of necrosis, while revealing cancer-specific biology, including a favorable angiogenic signature in renal cell carcinoma consistent with known molecular subtypes. Ablation studies demonstrated that these associations depend on the model's learned attention rather than concept prevalence alone, and that the concept dictionary captures much of the prognostic information encoded by the foundation model features. Through semantically-grounded explanations, SAGE provides a scalable, model-agnostic framework for understanding what ABMIL survival models learn, enabling pathologists to interpret model behavior at the cohort level and offering the potential for biomarker identification.
Abdallah Lamane, Abdul Rahman Diab, Ren-Chin Wu et al.· 0 citations
Spatial proteomics technologies have transformed our understanding of complex tissue architecture in cancer but present unique challenges for computational analysis1. Each study uses a different marker panel and protocol, and most methods are tailored to single cohorts, which limits knowledge transfer and robust biomarker discovery. Here we present Virtual Tissues (VirTues), a general-purpose foundation model for spatial proteomics that learns marker-aware, multi-scale representations of proteins, cells, niches and tissues directly from multiplex imaging data. From a single pretrained backbone, VirTues supports marker reconstruction, cell segmentation and typing, niche annotation, spatial biomarker discovery and patient stratification, including zero-shot annotation across heterogeneous panels and datasets. In triple-negative breast cancer, VirTues-derived biomarkers predict anti-PD-L1 chemo-immunotherapy response2 and stratify disease-free survival in an independent cohort3, outperforming state-of-the-art biomarkers derived from the same datasets and current clinical stratification schemes.
Johann Wenckstern, Eeshaan Jain, Benedikt von Querfurth et al.· Nature· 0 citations