On The Effectiveness-Fluency Trade-Off In LLM Conditioning: A Systematic Study
It is found that efficient steering methods frequently achieve conditioning at a steep cost to fluency, and a critical yet previously overlooked interaction with the training paradigm is identified: activation steering methods are far less effective on instruction-tuned models than on their base counterparts.