Valentin Noël

Where You Measure Decides What You Measure: Position Selection in Ablation-Based SAE Evaluation

Six autoencoders are trained from one initialisation, differing only in fitting choices, so that a latent means the same thing in each, and a causal number reported without its position describes the token it was taken at as much as the latent it was taken from.