Decalage: Uncovering the Gap Between Model-Generated Reasoning and Actual Code Implementation in Small Language Models
Agentic code generation often asks a model to explain its reasoning before it writes code, and a common way to make such a workflow safer is to add a security instruction to the prompt. We test what that instruction does in small language models, which are attractive because they run locally and cheaply. Four open code...