The Attention Within: Consensus Dynamics in Selective State Space Models
Selective state space models (SSMs) have recently emerged as a compelling alternative to transformers, combining competitive performance with substantially improved inference efficiency. At each SSM layer, a sequence of hidden states are propagated by a recurrence, mixing information of different tokens. Despite using...
João Pedro Silvestre, Álvaro Rodríguez Abella, Paulo Tabuada
· 1 citation