#artificial intelligence
Sep 2026
SMat-Attention: Structured Long-Context Sequence Modeling
This work introduces Structured Matrix Attention via a family of causal masks with structured long-range routing whose row supports have VC-dimension, which makes VC-dimension an explicit knob governing access-pattern complexity, prefill cost, and decoding memory.
E. Anand, Abdullah Ateyeh, Archer Wang et al.
· arXiv.org · 3 citations