Mar 2026· arXiv.org· Vol abs/2603.13584· 1 citation· 119 references
Computer Science
TL;DR
Biochemistry, Genetics and Molecular Biology has outpaced other natural scientific fields in PTM reuse, adaptation is the most prevalent PTM reuse pattern identified across all natural science fields, and the testing stage of the scientific process has been most impacted by PTM integration.
Abstract
Deep learning has achieved recognition for its impact within natural sciences, yet the prohibitive financial and technical cost of training models from scratch inhibit adoption. Following software engineering community guidance, natural scientists are reusing pre-trained deep learning models (PTMs) to amortize these costs. While prior works recommend PTM reuse patterns, we present the first empirical study of PTM reuse patterns in the natural sciences, quantifying the utilization and impact of PTM reuse within the scientific process across 17,718 peer reviewed, open access papers. Our results show that"Biochemistry, Genetics and Molecular Biology"has outpaced other natural scientific fields in PTM reuse,"adaptation"reuse is the most prevalent PTM reuse pattern identified across all natural science fields, and the"testing"stage of the scientific process has been most impacted by PTM integration.
Neural Architecture Search (NAS) serves as a performance engine for automated machine learning, driving intelligent advancements across various domains. However, its development has been significantly constrained by the prohibitively high computational costs involved. Training-Free Neural Architecture Search (TFNAS)...
Across several reasoning tasks and model families, the proposed frontier learning approach consistently achieves higher relative gains over fixed-pool baselines, demonstrating that effective post-training requires not only selecting useful problems, but continually generating them at the edge of capability.
Robin Faro, S. Ramesh, Ilija Bogunovic et al.· 0 citations
This study systematically compares seven pre-trained feature extractors across three architectural families, convolutional neural networks (CNNs), Vision Transformers (ViTs), and self-supervised models to provide practical guidance on model selection for downstream deep learning tasks.
Rafeek Sibrikhan, M. Mufassirin· Sri Lankan Journal of Techno...· 0 citations
The evidence supports a conditional, not universal, DL advantage whose practical value depends on architecture, validation protocol, data distribution, tuning quality, and deployment cost.
Wei-Xiang Gan, Jia-Lin Liu, Meng-Fei Xiao et al.· Engineering and Computing In...· 0 citations
A controlled study across several versions of two major TFM families finds a consistent pattern: feature engineering gains are concentrated in earlier model generations and become negligible for the strongest models, suggesting that stronger TFMs depend less on explicitly engineered input representations.
Yi-Fan Wu, Pin-Jun Dong, Jia Tao et al.· 0 citations
The engineering details of ADEPT are presented, a framework that integrates representative adequacy techniques, including neuron-coverage-based metrics, surprise adequacy, input distribution coverage, boundary coverage, and source- and model-level mutation score, under a consistent execution workflow.
Yidi Kao, Shawn Burnham, Tommi Rose Fahy et al.· 0 citations
