Opinion Leader Dynamics: How Sparse Attention Shapes Token Clustering
This work introduces opinion leader dynamics, a framework that identifies two mechanisms through which token groups converge internally while maintaining distinct limiting directions, and provides a dynamical account of how sparse attention can support alignment within groups while preserving separation between them.
Jing-Kun Liu, Yue Song
· 0 citations