A benchmark and training framework for shortcut-resistant cross-scale pathology reasoning, and an Adversarial Text-only Screening strategy for semantic reasoning questions and a Structure-controlled Distractor Sampling strategy for visual grounding questions, encouraging models to rely on cross-scale visual evidence.
Abstract
Pathological diagnosis is inherently multi-scale, requiring the integration of global tissue architecture at low magnification with cellular morphology at higher magnification. However, existing pathology benchmarks and vision-language models (VLMs) are still largely developed under single-scale settings, limiting their ability to learn clinically meaningful multi-magnification reasoning. Moreover, naively constructed visual question answering (VQA) tasks may be susceptible to text-only or superficial visual shortcuts, leading to unreliable assessments of visual understanding. To address these limitations, we introduce a benchmark and training framework for shortcut-resistant cross-scale pathology reasoning. We design an Adversarial Text-only Screening strategy for semantic reasoning questions and a Structure-controlled Distractor Sampling strategy for visual grounding questions, encouraging models to rely on cross-scale visual evidence. Based on this pipeline, we construct PathScale-VQA, a high-quality cross-scale pathology VQA benchmark with 10,373 multiple-choice questions grounded in 1,368 diagnostic paths across multiple magnification levels. Building on the semantic reasoning set, PathScale-R1 is optimized through Difficulty-driven Reasoning Distillation supervised fine-tuning followed by reinforcement learning with a Scale-aware Reasoning Structure reward, which encourages the use of evidence across magnifications. Extensive experiments demonstrate state-of-the-art performance of PathScale-R1 on cross-scale reasoning tasks and effective transfer to conventional single-scale pathology VQA. Our code is available at https://github.com/iMVR-PL/PathScale-R1.
CRAFT (Coarse-to-fine Region-Adaptive Feature Tokenization), a DINO-based framework that learns image-dependent mixed-scale representations by using self-supervised attention to selectively refine informative regions while preserving coarse context, together with a symmetric cross-scale regularization objective that en...
Anabel Stammer, Valay Bundele, Mehran Hosseinzadeh et al.· 0 citations
Multi-Resolution Pyramid Transformer (MRPT) is introduced, a model that hierarchically aggregates multi-resolution information from cellular to tissue and WSI levels and surpasses recent foundation models and Multimodal Large Language Models in cancer subtype classification, tissue phenotyping, and Visual Question Answ...
B. Alawode, Moshira Abdalla, Dwarikanath Mahapatra et al.· 0 citations
AdvLIF is introduced, an adversarially regularized and physics-inspired framework for jointly generating H&E-like and complementary auxiliary modalities from IHC images and segmenting nuclei and achieves superior quantitative fidelity, exemplified by the lowest error on the IHC Quantification Difference metric.
Qi Yu, Chun-Xue Shao, Ren-Yu Yang et al.· Journal of imaging informati...· 0 citations
This review examines retinal image analysis from the perspective of clinical translation rather than benchmark-oriented model comparison, arguing that the next stage of retinal AI requires transferable representations, robust external evaluation, trustworthy uncertainty handling, and demonstrated value within real-worl...
Jia-Yao Chen, Xiao Feng, Hao Hu et al.· Artificial Intelligence in M...· 0 citations
A clinically curated Pan-Asia WSI--report dataset is introduced and the REG 2025 benchmark is established as a benchmark for evaluating WSI-based structured report generation and vision-language understanding in computational pathology, providing insights for the design of clinically grounded multimodal pathology model...
Yu-Mi Lee, Harim Oh, Hyo-yun Kim et al.· 0 citations
This work proposes HarMoE, a dataset-aware mixture-of-experts framework that learns shared cross-dataset medical semantics while confining source-specific variation to lightweight residual experts in deeper decoder layers, and trains in a unified disease vocabulary with masked multi-dataset supervision, enabling the mo...
Haozhe Luo, Zi-Yu Zhou, Shelley Zixin Shu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.