Preprint
Jul 2026
Akashic: A Low-Overhead LLM Inference Service with MemAttention
This work proposes Akashic, a low-overhead memory system built around MemAttention, which organizes context into bounded chunks and models semantic relationships across chunks, preserving cross-chunk evidence without repeatedly rewriting the full history.
Yang Liu, ZhaoKai Luo, Huayi Jin et al.
· 0 citations