Signatures of Steerability in Activation Space of Language Models
Steering language models using a set of contrastive representations has been a canonical and computationally efficient method for controlling model behavior. Despite this success in controlling certain model behaviors, the effectiveness of activation steering varies markedly across concepts; the generalization properti...
Prajjwal Bhattarai, Tuka Alhanai
· 0 citations