World Properties without World Models: Distributional Associations and the Interpretation of Decoding Results from Language Models
It is shown that static word embeddings of the same or matched stimuli of the same or matched stimuli support much of the same decoding, indicating that decodability alone cannot distinguish a representation of a property from information already available in fixed distributional associations.