Preprint
Jul 2026
Mergeable Model-Side Aggregation States for Long-Context Language Models
A model-side aggregation interface is introduced that maintains compact Hash-based HyperLogLog sketch states alongside a frozen language model that improves over direct full-context reasoning over chain-of-thought reasoning.
Dachuan Song, Ju Yin, Zechen Hu et al.
· 0 citations