LSM-based storage engines are increasingly deployed in cloud storage systems and are moving toward disaggregated architectures. When compute and storage resources are separated, LSM compaction becomes a cross-node resource-control problem. Compute-side compaction can generate heavy RDMA network traffic when fetching re...
Zhiyuan Lou, Guo-Li Wei, Qing-Yang Zhang et al.· Proceedings of the 18th ACM...· 0 citations
LLM-based applications increasingly rely on persistent state stores to maintain durable memories across long-running interactions. Unlike conventional storage systems, these stores often invoke LLMs on the write path to transform raw context into semantic state, shifting maintenance cost from bytes written to tokens pr...
Shi-Jun Yang, Shu-Heng Gao, Chao Yan et al.· Proceedings of the 18th ACM...· 0 citations
AFlex is a framework that jointly optimizes resource provisioning and GPU frequency scaling for disaggregated A/F serving and reduces energy per token by up to 49% over state-of-the-art disaggregated serving and 48% over frequency-scaling systems while satisfying TTFT and TPOT SLOs.
Cun-Chen Hu, Liangliang Xu, Tianyu Liu et al.· 0 citations
CoCache is presented, a cooperative cache-management framework that continuously tunes the metadata-data cache split and combines lightweight online hotness tracking with a unified latency model that captures the coupled impact of metadata and data caching on the read path.
Haoting Tang, Wenzhe Zhu, Qingyang Zhang et al.· International Conference on...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
