Logical subspace in LLMs
The minimal viable subspace (MVS) method, which searches for the lowest-rank activation subspace at a layer that preserves task performance when everything outside that subspace is ablated, suggests a functionally localizable core machinery for logic akin to that in the human brain.