Hierarchical EXplainable Multiple Instance Learning (Hierarchical EXplainable Multiple Instance Learning), a mask-free medical deepfake detector that simultaneously addresses both limitations using only binary volume-level supervision.
Abstract
The emergence of medical deepfakes, i.e., medical images manipulated by deep generative models, poses a significant threat to clinical workflows. However, existing detectors suffer from two critical limitations: poor generalization to unseen generative architectures for manipulation detection and lack of interpretability. In this context, we present HexMIL (Hierarchical EXplainable Multiple Instance Learning), a mask-free medical deepfake detector that simultaneously addresses both limitations using only binary volume-level supervision. HexMIL decomposes each CT volume into a two-level hierarchy of patches and slices, aggregated via independent Gated Attention modules whose weights are directly combined into a full-resolution 3D attention volume that localizes the manipulated sub-region without any pixel-level annotation. Unlike post-hoc methods such as Grad-CAM, HexMIL's attention weights constitute the exact forward computation driving the classification decision, providing ante-hoc and structurally faithful spatial attribution. We evaluate HexMIL on M3DSynth and CT-GAN datasets under a rigorous cross-generator generalization protocol, training on a single generative architecture and testing on unseen ones. HexMIL outperforms all baselines by $+9.1$ AUC and $+9.4$ F1 in out-of-domain classification, and achieves the best average IoU and Pointing Game score in localization. Project page: opontorno.github.io/hexmil.
Automated classification of renal computed tomography (CT) can accelerate triage and extend reliable screening to settings where specialist expertise is scarce, yet the most accurate deep models rely on heavy general-purpose backbones, exploit only a single visual scale, and offer little insight into the basis of their...
Hui-Hui Xie, Taifeng Yao, Jin-Feng Cao· Journal of King Saud Univers...· 0 citations
Vision-Language Pretrained Models (VLPMs) offer a scalable path to open-vocabulary chest radiology understanding, yet two aspects remain underexplored: how structured clinical semantics extracted from medical reports can reduce in-batch noise during contrastive learning, and how cross-modal fusion can be designed to pr...
Jianzhong You, Yuan Gao, Chris McIntosh· 0 citations
HierTAC-Net is proposed, a six-stage convolutional classifier that combines inverted residual blocks, triple attention at three resolution levels, and ConvNeXt-style refinement that is suitable for real-time deployment and remains stable under common artifacts and across two clinical collections.
M. Mia, A. Khandakar, Sawal Hamid Bin Mohd Ali et al.· Scientific Reports· 0 citations
This work evaluates three independent forms of structured supervision: topological priors via graph self-supervision, dense pixel-level constraints via segmentation, and cross-modal semantic grounding via image-text pairs, and finds that image-text alignment achieves the most superior performance.
He-Xiang Bai, Han-Yang Xu, Xiao-Xue Li et al.· 0 citations
This work introduces Latent-Attention Masked Autoencoder (LAMAE), a multimodal, structure-aware masked autoencoder that jointly learns patient-level representations during self-supervised pretraining that outperforms modality-specific pretraining and strong contrastive and vision-language baselines across multimodal ho...
Andrea Agostini, Simon Böhi, Moritz Vandenhirtz et al.· 0 citations
The challenge of early detection of Alzheimer's Disease (AD) and Mild Cognitive Impairment (MCI) is a neuroimaging challenge that has not been solved yet, as conventional deep learning architectures are not well suited to extract fine-grained localized features from the image while preserving the long-range structural...
S. Lokesh, P. Muthukumaraswamy, S. Priyan et al.· 2026 International Conferenc...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.