Yi-Fan Qin

Interface-Aware KV Cache Quantization for Dense On-Chip NVM in Long-Context LLM Decoding

The architecture stores the quantized KV cache in dense on-chip NVM, uses a small static analog crossbar only for the fixed rotation, and keeps attention in on-chip digital logic.