RACE: Scalable Statistical Estimation of Functional Consistency in LLM Neurons
RACE (Residual Alignment for Consistency Estimation), a forward-pass statistical framework that evaluates the domain-wide functional consistency of Transformer neurons, produces neuron rankings that yield more domain-specific effects under perturbation.
Runyu Wang, Bo Liu, Xia-Xin Zhang et al.
· 0 citations