RegimeFormer is presented, a large protein perturbation model coupled to RegimeAtlas, which is constructed by harmonizing, representing and indexing 202,556,313 non-redundant protein sequences across the tree of life to establish a large-model framework for mapping, predicting and querying protein perturbation landscapes across global sequence space.
Abstract
Protein language models organize sequence and structure at scale; here we add a global coordinate system for how proteins respond to mutation.1–12 We present RegimeFormer, a large protein perturbation model coupled to RegimeAtlas, which we constructed by harmonizing, representing and indexing 202,556,313 non-redundant protein sequences across the tree of life. This full sequence universe defines the atlas-wide protein-regime map. A diversity-preserving one-million-protein subset provides the high-resolution training and inference layer, with 995,995 proteins yielding 407,048,356 residue summaries and substitution-specific predictions available on demand. Across experimental DMS, molecular benchmarks, structural confidence and evolutionary constraint, RegimeFormer reveals reproducible protein-level perturbation regimes that organize residue fragility, adaptability and uncertainty. Explicit regime conditioning improves substitution-specific reconstruction and shows its largest relative advantage under unseen-protein, unseen-family and low-homology evaluation. The resulting molecular priors also improve downstream transcriptomic and drug-response modelling. Together, RegimeFormer and the 202.6-million-sequence RegimeAtlas establish a large-model framework for mapping, predicting and querying protein perturbation landscapes across global sequence space.
ProtLingo, an efficient PLM framework that augments a pretrained single-sequence backbone with conditional local memory and sparse expert routing, achieves competitive performance with a 150M-scale backbone, including strong parameter efficiency on mutation-effect prediction and preserved long-range structural represen...
Ming-Rui Li, Si-Xian Shen, Min-Zhang Li et al.· 0 citations
Accurate prediction of mutation-induced protein stability responses, including changes in folding free energy and melting temperature, is critical for protein engineering. Existing models represent these related but non-equivalent measurements separately and often focus on single mutations. Here we present OmegaTherm,...
An unsupervised inference model that integrates directed-evolution sequencing time series with natural homologs is presented and the inferred couplings improve structural contact prediction by combining global evolutionary constraints from nature with local, experiment-specific signals.
Matteo De Leonardis, Andrea Pagnani· bioRxiv· 0 citations
This work demonstrates how to provide task-specific information without losing the general knowledge learned during pretraining by using direct preference optimization to align a structure-conditioned protein language model to preferentially generate stable protein sequences.
Talal Widatalla, Ashir Borah, Samuel H. King et al.· Nature Methods· 3 citations
This work introduces ZEST (Zoned Encoding of Sequence Traits), an evolution-informed vocabulary derived from conserved regions of multiple sequence alignments that demonstrates that evolution-informed tokenization can substitute for massive parameter scaling, opening a new direction for efficient, biologically-grounded...
Biswajit Banerjee, Claudia A. Carreno, Anton S. Petrov· 0 citations
StabilityArc is presented, which maps frozen ESMC-600M residue representations through a shared RoPE transformer to an Lx20 matrix of substitution effects; a symmetric, contact-aware residual aids in predicting epistasis in simultaneous substitutions.
Aaron L. Feller, Andrew D. Ellington, Claus O. Wilke· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.