R. Kondor

Deep Minds and Shallow Probes

It is proved that, under standard nondegeneracy assumptions, behaviorally equivalent LLMs have hidden representations related by an invertible affine transformation, and it is shown that a natural object for cross-model probe transfer is a shared probe-visible quotient--the representation modulo directions invisible to...