Oct 2026· Journal of Computers, Mechanical and Management· Vol 5, pp. 64-84· 0 citations· 38 references
TL;DR
This work presents MORSE (Morphological Observation with Reweighted Spectral Encoding), a minimal architecture that incorporates specific inductive biases by performing multi-scale morphological operations, adaptive gating of the spectrally decomposed signals, and memory-efficient hierarchical fusion, suggesting that domain-specific architectural innovation is a viable alternative for specialized diagnostic tasks.
Abstract
In medical image analysis, transfer learning from ImageNet-pretrained models is a dominant paradigm, but its effectiveness on small clinical datasets is questionable. In this work, we challenge this understanding by showing that paradigms for natural image encoders can fundamentally fail to suit the medical imaging context for early disease detection, where data are scarce. We present MORSE (Morphological Observation with Reweighted Spectral Encoding), a minimal architecture that incorporates specific inductive biases by performing multi-scale morphological operations, adaptive gating of the spectrally decomposed signals, and memory-efficient hierarchical fusion. MORSE is evaluated on four clinical medical imaging tasks from dermatology, ophthalmology and neurology, and shows consistent improvements over eight state-of-the-art (SoTA) baselines trained from random initialization, as well as ImageNet-pretrained models and a RadImageNet-pretrained ResNet-50 (the only RadImageNet backbone tested). With limited training data, MORSE outperforms the strongest from-scratch baselines by 0.83 to 5.00 percentage points and exceeds the best pretrained models by 0.23 to 2.27 percentage points, whereas pure vision transformers underperform by approximately 16 to 45 percentage points on the three smaller datasets. Ablation studies support the complementary contributions of morphological and spectral features, and parameter analysis shows that architecture design using medical imaging priors can be more consequential than model capacity in the evaluated small-data settings. These studies challenge the prevailing reliance on transfer learning in data-constrained medical imaging, suggesting that domain-specific architectural innovation is a viable alternative for specialized diagnostic tasks.
Foundation models (FMs) and vision-language models (VLMs) have emerged as a transformative paradigm in artificial intelligence, reshaping the landscape of medical image analysis and clinical decision support. Building upon large-scale pretraining on heterogeneous datasets, these models exhibit unprecedented generalizat...
Saeed Mohsen, Leena Mahmoud Lulu, Mohamed Eassa et al.· Computers· 0 citations
Recent advances in deep learning and foundation models have created a strong improvement in the analysis of surgical images and videos. However, in clinical applications, surgical AI still faces fundamental limitations: expert annotations are scarce and expensive, clinically relevant classes and events are often highly...
Klaus Schoeffmann· Proceedings of the 3rd Inter...· 0 citations
Machine learning with limited data is susceptible to overfitting, especially with modern deep neural networks. Prior to the introduction of AlexNet, reconstruction-based pretraining with auto-encoder and denoising auto-encoder were found to be beneficial, partially due to the limited size of the training sets at the ti...
Qin-Yu Li, Y. Teh, Chris C. Holmes et al.· 0 citations
Imaging techniques such as chest X-rays, whole slide images (WSI), and optical coherence tomography (OCT) serve as primary screening and detection tools for a wide variety of pulmonary and ophthalmic conditions. This paper presents a systematic and unified empirical investigation of the impact of ImageNet-pretrained de...
Jutika Borah, H. Singh· Neural computing & applicati...· 0 citations
Medical image processing by computers has become an area of growing importance, with researchers shifting their attention to various groundbreaking state-of-the-art models that aim to ease the pressure on doctors. Notwithstanding, image segmentation and feature extraction are critical yet challenging tasks in clinical...
Maame G. Asante-Mensah, C. R. Haruna, S. Atsu et al.· ICCK Transactions on Machine...· 0 citations
Due to the limited availability of annotated medical datasets, medical image classification typically relies on transfer learning from large-scale natural image datasets such as ImageNet. However, it remains unclear when domain-specific pretraining offers greater benefits. This study evaluates the impact of different p...
Luka Kršul, Dominik Vičević, F. Hržić et al.· Journal of Imaging· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.