The Geometry of Logic: Stratification Induces Semantic Structure and Robust Reasoning
STRAT is introduced, which partitions the residual stream into orthogonal Data and Type subspaces and uses Type-based attention and gating to govern Data transformations and in arithmetic, STRAT reduces median OOD error 35-fold relative to a Transformer baseline.