Author

Yang Li

h-index 0 View on Semantic Scholar

We have 1 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

Autonomy-of-Heads: Data-Free Sparse Attention from Frozen Query-Key Geometry

Long-context LLM inference is bottlenecked by quadratic attention computation and growing KV-cache costs. Existing sparse attention and KV-compression methods typically decide which tokens or heads to preserve from runtime attention scores, observation windows, calibration prompts, or learned gates, making head diagnos...

YeHan Yang, Jun-Yuan Shang, Yang Li et al. · 0 citations