Composable CXL Memory as a Kubernetes-Native Shared Memory for LLM Serving
A DRA driver is presented that makes composable CXL memory a schedulable cluster resource, and the resulting shared-memory tier for cross-node KV-cache reuse in LLM serving is evaluated, demonstrating memory disaggregation rather than prefill/decode disaggregation.
Hong-Jiang Fan, Ke-Rao Zhang, David Habinsky et al.
· 0 citations