SharedSAE: One Feature Dictionary Across Language Models
This work shows that a single shared SAE can replace a collection of dedicated per-model SAEs, and combines a shared dictionary with model-specific encoder-decoder pairs to achieve near-dedicated-SAE reconstruction quality.