Learning to Decide, Not to Reason: Parameter-Efficient Decision Operators via Low-Rank Activation Steering
DecSteer, a System-1 decision operator trained by behavior cloning that lowers this cost of injecting skills into a frozen language model by roughly two orders of magnitude, is introduced.
Ran Li, Lei Chen
· 2 citations