Minimally Invasive Steering of Language Models
Minimally Invasive Steering Vector Optimization (MISVO), which penalizes interventions using the local KL geometry of the induced token distribution, achieves the highest mean reward in six of seven model--task settings, with diversity and coherence scores close to those of Best-of-N.