Liquid Gated Attention
This work proposes Liquid Gated Attention (LGA), a solver-free parallel temporal operator that introduces a continuous-time inductive bias and formulates hidden state evolution as a fast-weight associative memory, enabling parallel computation across the temporal dimension.
Yi-Heng Jiang, Yuanbo Xu, Yongjian Yang
· 0 citations