Jia-Qi Deng

Computation Over Geometry: Meaning Identity Is Computed, Not Shipped in the Embeddings

It is shown that, for frozen off-the-shelf encoders and language models, identity is computed when both sentences share one forward pass, and is not a property of the embedding geometry those systems ship.