Author

Inho Song

h-index 1 View on Semantic Scholar

We have 2 of 8 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

2026

HyMCache: A KV Cache Framework for Multi-Turn LLM Serving with CXL-Hybrid Memory

HyMCache is presented, a KV-cache framework that integrates CXL-hybrid memory (CXL-HM) for multi-turn LLM serving that uses request-level prefix prefetching and opportunistic write buffering to stage latency-critical reads in device DRAM, enabling DRAM-scale KV-cache efficiency at SSD-level cost.

Hakbeom Jang, Inho Song, Sam H. Noh et al. · arXiv.org · 2 citations · ⚡1

Preprint Jul 2026

A CXL Memory Rack for Multi-Turn LLM Serving

This paper presents HyMCache, a CXL memory rack for multi-turn LLM serving using cost-efficient CXL-hybrid memory, which combines a small amount of in-device DRAM with large SSD-backed capacity behind a CXL interface to efficiently support TB-scale SSD-backed KV reuse.

Hakbeom Jang, Inho Song, Hoshik Kim et al. · 0 citations