Latent space bias directions in LLMs capture confidence, not fairness
Activation steering has gained popularity as a lightweight inference-time debiasing technique for large language models. However, prior work reports that steering vectors generalise poorly, with unintended effects on model performance and limited transfer to new datasets. Our work analyses what the debiasing direction...
Stephanie Buttigieg, Maeve Madigan, P. Kamalaruban et al.
· 1 citation
· ⚡1