Author

I-Hung Li

h-index 1 View on Semantic Scholar

We have 1 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

Sigmoid Attention as a Better Substrate for Learned KV Cache Eviction

It is suggested that attention normalization can substantially affect whether a training-time soft gate transfers cleanly to hard KV deletion, whereas softmax gates do not uniformly beat these post-hoc methods.

I-Hung Li · 0 citations