A metric-learning framework that trains a projection head over a frozen protein language model (PLM) encoder with hybrid negative mining with hybrid negative mining under a joint triplet–focal objective that remains structurally robust under extreme class imbalance and may also serve other protein-function detection problems with scarce positives.
Abstract
MOTIVATION
Anti-CRISPR (Acr) proteins inhibit CRISPR-Cas immunity and are key targets for precise control of CRISPR-based genome editing and phage-host coevolution research. Their experimental identification is costly and low-throughput, so computational predictors are used to prioritise candidates for testing. In this setting validated positives number in the hundreds while phage-derived putative negatives reach tens of thousands, producing extreme class imbalance. Yet existing classification-based predictors train and evaluate on 1:1 balanced datasets and allow high-similarity sequences between training and test, overestimating real-world performance.
RESULTS
We present AcrSeek, a metric-learning framework that trains a projection head over a frozen protein language model (PLM) encoder with hybrid negative mining (offline global plus online semi-hard) under a joint triplet-focal objective. Under nested 5-fold cross-validation with leakage controlled by 40% identity clustering, AcrSeek improved AUPRC on the imbalanced (1:383) test set from 0.017 to 0.355 over AcrNET (matched PLM backbone), reaching 0.508 with ESM-2 3B. AcrSeek therefore remains structurally robust under extreme class imbalance and may also serve other protein-function detection problems with scarce positives.
AVAILABILITY AND IMPLEMENTATION
Source code at https://github.com/jeongchans/acrseek, archived at Zenodo (DOI: 10.5281/zenodo.21946803); data and model checkpoints at Zenodo (DOI: 10.5281/zenodo.20115442).
SUPPLEMENTARY INFORMATION
Supplementary data are available at Bioinformatics online.
Five machine learning classifiers are benchmarked on a real, published GUIDE-seq off-target dataset and the low absolute precision achievable in this severely imbalanced, small-positive-class setting is reported, as a realistic picture of what off-target classifiers can and cannot yet deliver from sequence alone.
Although protein toxins represent valuable pharmacological templates, predicting toxicity directly from primary sequences is inherently challenging because of their evolutionary dynamics. Active toxins and their benign homologues frequently share identical structural scaffolds and differ by only a few key residue subst...
Seongmin Kim, Min-Seok Kim, Chungoo Park· bioRxiv· 0 citations
DeepEffector is a high-precision predictor for fungal and oomycete effector identification, providing a reliable high-confidence candidate list to reduce downstream experimental screening and offering an accessible pipeline to accelerate effector discovery and support crop protection research.
Tao Li, Qian-Lin Meng, Dan-Yang Wang et al.· Plant Physiology· 0 citations
Results demonstrate that BFPSM outperforms state-of-the-art methods at the sequence level, highlighting its utility for clinical and functional variant prioritization.
Hai-Zhou-Rong Chen, Si-Yuan Yang, Chen Ye et al.· Computational biology and ch...· 0 citations
This work introduces LAMBDA, a benchmark designed to rigorously evaluate genome language model embeddings through phage-bacteria sequence discrimination across four categories of increasing complexity: probing tasks, fine-tuning assessments, diagnostic tests, and genome-wide prophage detection.
LeAnn M. Lindsey, Nicole L. Pershing, K. Dufault-Thompson et al.· NAR Genomics and Bioinformat...· 0 citations
Predicting cellular responses to genetic perturbations helps prioritize experiments in single-cell genomics, where exhaustive measurement is infeasible. While computational models increasingly predict these responses, three evaluation deficiencies obscure what their scores demonstrate. First, absolute metrics cannot se...
Si-Kai Huang, Zhi-Wen Yang, Kai Yu et al.· 0 citations
A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.