ProtLingo: Efficient Protein Language Modeling via Conditional Memory and Expert Routing
ProtLingo, an efficient PLM framework that augments a pretrained single-sequence backbone with conditional local memory and sparse expert routing, achieves competitive performance with a 150M-scale backbone, including strong parameter efficiency on mutation-effect prediction and preserved long-range structural represen...
Ming-Rui Li, Si-Xian Shen, Min-Zhang Li et al.
· 0 citations