Riemannian Geometry for Pre-trained Language Model Embeddings
Understanding the geometric structure of pre-trained language model embeddings matters for interpretability and safety. We ask whether sentence-level classification signal lives in the Riemannian geometry of contextual token embeddings, and probe it by extracting per-token pullback metrics from a learned encoder's anal...
S. Konior, Alexandre Quemy, Przemyslaw Klocek et al.
· 0 citations