Manya Phutela

Towards Sparse Causal Features for Zero-shot Mutation Effect Prediction in a Protein Language Model

Protein language models (pLMs) such as ESM-2 achieve strong zero-shot mutation-effect prediction, yet the internal computations supporting these predictions remain poorly understood. We introduce a sparse feature circuit framework that combines sparse autoencoders, integrated-gradients attribution, and activation patch...