Skip to content
Open access

RegimeFormer: A Large Protein Model of Global Perturbation Regimes

Aug 2026 · bioRxiv · 0 citations
Biology

TL;DR

RegimeFormer is presented, a large protein perturbation model coupled to RegimeAtlas, which is constructed by harmonizing, representing and indexing 202,556,313 non-redundant protein sequences across the tree of life to establish a large-model framework for mapping, predicting and querying protein perturbation landscapes across global sequence space.

Abstract

Protein language models organize sequence and structure at scale; here we add a global coordinate system for how proteins respond to mutation.1–12 We present RegimeFormer, a large protein perturbation model coupled to RegimeAtlas, which we constructed by harmonizing, representing and indexing 202,556,313 non-redundant protein sequences across the tree of life. This full sequence universe defines the atlas-wide protein-regime map. A diversity-preserving one-million-protein subset provides the high-resolution training and inference layer, with 995,995 proteins yielding 407,048,356 residue summaries and substitution-specific predictions available on demand. Across experimental DMS, molecular benchmarks, structural confidence and evolutionary constraint, RegimeFormer reveals reproducible protein-level perturbation regimes that organize residue fragility, adaptability and uncertainty. Explicit regime conditioning improves substitution-specific reconstruction and shows its largest relative advantage under unseen-protein, unseen-family and low-homology evaluation. The resulting molecular priors also improve downstream transcriptomic and drug-response modelling. Together, RegimeFormer and the 202.6-million-sequence RegimeAtlas establish a large-model framework for mapping, predicting and querying protein perturbation landscapes across global sequence space.

Read PDF

Similar papers

#artificial intelligence Preprint Sep 2026

ProtLingo: Efficient Protein Language Modeling via Conditional Memory and Expert Routing

ProtLingo, an efficient PLM framework that augments a pretrained single-sequence backbone with conditional local memory and sparse expert routing, achieves competitive performance with a 150M-scale backbone, including strong parameter efficiency on mutation-effect prediction and preserved long-range structural represen...

Ming-Rui Li, Si-Xian Shen, Min-Zhang Li et al. · 0 citations
Open access Sep 2026

Unified modeling of mutation-induced protein stability responses with OmegaTherm

Accurate prediction of mutation-induced protein stability responses, including changes in folding free energy and melting temperature, is critical for protein engineering. Existing models represent these related but non-equivalent measurements separately and often focus on single mutations. Here we present OmegaTherm,...

Wen-Kang Wang, Yi-Hang Zhou, Wen-Tao Yu et al. · 0 citations
Open access Sep 2026

Modeling Protein Sequence Evolution as an Ornstein-Uhlenbeck Process in a Latent Space

An unsupervised inference model that integrates directed-evolution sequencing time series with natural homologs is presented and the inferred couplings improve structural contact prediction by combining global evolutionary constraints from nature with local, experiment-specific signals.

Matteo De Leonardis, Andrea Pagnani · 0 citations
Open access Aug 2026

Aligning protein-generative models to experimental fitness with ProteinDPO

This work demonstrates how to provide task-specific information without losing the general knowledge learned during pretraining by using direct preference optimization to align a structure-conditioned protein language model to preferentially generate stable protein sequences.

Talal Widatalla, Ashir Borah, Samuel H. King et al. · 3 citations
#machine learning Preprint Sep 2026

LEMON-ZEST: Evolution-Informed Tokenization for Efficient Protein Language Modeling

This work introduces ZEST (Zoned Encoding of Sequence Traits), an evolution-informed vocabulary derived from conserved regions of multiple sequence alignments that demonstrates that evolution-informed tokenization can substitute for massive parameter scaling, opening a new direction for efficient, biologically-grounded...

Biswajit Banerjee, Claudia A. Carreno, Anton S. Petrov · 0 citations
#machine learning Preprint Sep 2026

StabilityArc: Decoding Protein Sequence Embeddings into Generalizable Stability Landscapes

StabilityArc is presented, which maps frozen ESMC-600M residue representations through a shared RoPE transformer to an Lx20 matrix of substitution effects; a symmetric, contact-aware residual aids in predicting epistasis in simultaneous substitutions.

Aaron L. Feller, Andrew D. Ellington, Claus O. Wilke · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.