César Castro

From Dyadic Derivatives to Pareto Circuit Surgery: Resolving the Quantization Wall, Static-Vector Dilution, and Low-Rank Attention Editing in Qwen2.5-7B

Prior work on Qwen2.5-7B-Instruct showed that the raw size of a residual-stream displacement does not predict its effect, while a simple pre-intervention measure of local sensitivity does rank which soft patches will move the model’s decision margin. Three problems remained. A second-order curvature assay failed, in pa...