M. Khalili

When Pruning Meets Interpretability: Preserving Sparse Autoencoder Robustness in LLMs

A systematic study of how pruning affects SAE behavior is presented and theoretically shows that, for a fixed SAE, its impact is governed by perturbation energy, a covariance-weighted norm.