#machine learning
Apr 2026
FG2-GDN: Enhancing Long-Context Gated Delta Networks with Doubly Fine-Grained Control
Experiments on synthetic and real-world benchmarks show that FG$^2$-GDN and its variant improve associative recall and long-context understanding over GDN and KDA, with comparable computational efficiency.
Ping-Wei Sun, Yuxuan Hu, Jian-Chao Tan et al.
· arXiv.org · 1 citation
· ⚡1