Skip to content
Preprint

LoRe-MIM: Lost-or-Replaced Masked Image Modeling for Self-Supervised Representation Learning in Whole-Body PET/CT

Oct 2026 · 0 citations · 48 references
Computer Science

TL;DR

Experimental results demonstrate that LoRe-MIM consistently outperforms the corresponding state-of-the-art baselines across these tasks, highlighting its potential as a scalable and generalizable self-supervised learning framework for whole-body PET/CT analysis.

Abstract

Deep learning models for whole-body positron emission tomography/computed tomography (PET/CT) hold significant clinical potential for disease detection, treatment planning, and response assessment. However, the time and cost associated with expert annotations remain major bottlenecks in developing robust and generalizable models. Although self-supervised learning (SSL) has emerged as a promising approach to mitigating annotation scarcity, its application to whole-body PET/CT remains relatively underexplored due to the limited availability of large-scale datasets and the challenges associated with learning complementary cross-modal representations. To address these limitations, we curate a heterogeneous, multi-tracer, multi-institutional cohort comprising 6,531 whole-body PET/CT scans and propose LoRe-MIM (Lost-Or-Replaced Masked Image Modelling), a novel self-supervised framework designed to learn multimodal representations through masked image reconstruction. Specifically, LoRe-MIM introduces a masking strategy in which image regions are either replaced with zeros (Lost) or substituted with corresponding complementary imaging modality (Replaced), encouraging the model to capture both modality-specific characteristics and cross-modal relationships. We evaluate the learned representations across multiple downstream tasks, including multimodal PET/CT image reconstruction, patch-based classification into cancer vs. non-cancer, whole-body lesion segmentation, label-efficient training, and robustness assessment. Experimental results demonstrate that LoRe-MIM consistently outperforms the corresponding state-of-the-art baselines across these tasks, highlighting its potential as a scalable and generalizable self-supervised learning framework for whole-body PET/CT analysis.

View source

Similar papers

Preprint Oct 2026

Domain-Adapted Latent Diffusion Models for CT-to-PET Image Translation

Positron Emission Tomography (PET) provides important metabolic information for tumor detection and staging but remains significantly less accessible than Computed Tomography (CT) due to its high cost, infrastructure requirements, and reliance on injected radioactive tracers. CT-to-PET image translation using generativ...

Y. Bourdé, Lea Bogensperger, Arnela Hadzic et al. · 0 citations
Sep 2026

Efficient 3D Whole-Body PET Image Denoising via Conditional Rectified Flow With Optimized Sampling Strategy

Reducing radiation exposure in Positron Emission Tomography (PET) is important for patient safety; however, ultra-low-dose imaging suffers from severe noise, which may affect diagnostic interpretation without appropriate image enhancement. While current 3D deep generative models, particularly diffusion models, have sho...

Jia-Le Shen, Guo-Lin Wang, Chen-Hao Wang et al. · 0 citations
Preprint Sep 2026

Generative Priors for Total-Body PET Reconstruction

Total-body positron emission tomography (TB-PET) enables fast, low-dose, and dynamic imaging over a long axial field of view, but reconstruction remains challenging due to reduced counts, large image volumes, and increased data dimensionality. Generative models offer powerful learned priors for low-count PET, yet expli...

Movindu Dassanayake, George Webber, Denis Prokopenko et al. · 0 citations
Review Open access Oct 2026

From task-specific AI to multimodal foundation models in PET/CT: a readiness framework for clinical translation

Artificial intelligence in PET/CT is evolving from narrowly optimized systems toward reusable pretrained representations and multimodal models. PET/CT is a demanding test case because clinically meaningful interpretation must preserve quantitative molecular information while integrating anatomic CT, acquisition metadat...

A. Muneer, Maliazurina B. Saad, Hui Xu et al. · 0 citations
Open access Oct 2026

UniPET: a unified approach for whole-body CT to PET translation

UniPET is introduced, a unified approach for whole-body CT-to-PET translation based on curriculum learning that provides a promising approach for augmenting CT-based workflows with synthetic metabolic information, with potential applications in screening triage, in low-resource environments where PET is unavailable, an...

Francesco Di Feola, V. Guarrasi, Mikael Johansson et al. · 0 citations
Preprint Nov 2026

Leveraging High-Activity Post-Therapeutic I-131 Scans for Deep Learning Reconstruction of Extremely Sparse Planar Images in Differentiated Thyroid Cancer

Background: Diagnostic I-131 whole-body planar imaging in differentiated thyroid cancer (DTC) is count-limited by low administered activity, and quality worsens under rapid acquisition. Models trained on such data struggle because their targets lack photon statistics. Purpose: To test whether high-quality post-therapeu...

Bo-Yang Pan, Hang Yang, Jian-Chen Pan et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.