Entangled by Design: Spurious Intra-Variable Signal Routing in Tabular In-Context Learners
It is proved that under ridge ICL, a linear in-context learner, this routing is unavoidable regardless of context size; TabPFN, a state-of-the-art pretrained tabular ICL model, shows qualitatively consistent behaviour empirically, and two lightweight mitigations are introduced.