Skip to content

Author

Zhi-Yuan Liu

We have 2 of 32 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Competing Learning in Hybrid Architectures

Many modern language models have adopted hybrid architectures that incorporate both linear-time recurrence and softmax attention. Modern recurrence layers provide a highly expressive mixing mechanism while ensuring high throughput by compressing contextual information into a fixed-size state, but underperform softmax a...

Xing-Yu Shen, Yingfa Chen, Zi-Qing Qiao et al. · 0 citations

NOSA: Native and Offloadable Sparse Attention

This work proposes NOSA, a trainable sparse attention mechanism natively designed for KV cache offloading that explicitly constrains the volume of CPU-GPU KV transfers, thereby achieving low communication overhead and high decoding throughput.

Yu-Xiang Huang, Peng-Jie Wang, Ji-Cheng Han et al. · 4 citations · ⚡1

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.