Harness-Aware Distillation for Small Language Model Agents
Language model agents are deployed with a harness, the software around the model that manages its context, tools, and feedback. When such an agent is distilled into a smaller one, the harness stays in place, so the student mainly needs the teacher-specific abilities that the harness cannot provide, such as acting corre...
Moonseok Choi, Taehong Moon, G. Nam et al.
· 0 citations