OBASE is presented, a compiler-runtime system for unmanaged languages that serves as an object-aware front-end for page-aware OS backends that enables unmodified backends to tier memory effectively and reduces memory footprint by up to 70%, with only 2–5% overhead.
This work implements PagePilot, a reuse-aware page offloading framework for heterogeneous swap systems that improves application throughput and reduces page-fault handling latency under memory pressure, while substantially increasing the fraction of refaults served by fast backends.
Xing-Ze Liu, Jiayan Dong, Xin-Yue Liu et al.· ACM Transactions on Architec...· 0 citations
This poster observes the stall from inside the kernel, using the multi-volume data placement proposed in SteelDB as the experimental lever to observe the stall from inside the kernel.
Tierce, an observability substrate for colocated tiered memory, estimates workload-local exposed stall by measuring per-workload memory-level parallelism and scoring pages by realized access latency, and bounds LLC interference with explicit cache-way allocation.
Han-Chen Xu, Berkay Inceisci, Hao Li et al.· Proceedings of the ACM SIGOP...· 0 citations
KV-cache offload is widely used to stretch GPU memory for LLM serving, but its storage behavior has not been characterized at the block-device level. In this paper, we study LMCache through realworld multi-session workloads that span same/different context $\times$ same/different prompt, using over 100 stateless reques...
Ying He, Dingsen Shi, Yanbo Dai et al.· 2026 International Conferenc...· 0 citations
The design of NLock enables an efficient local hand-over mechanism and in turn, achieves substantial performance advantages by co-optimizing lock design with modern NUMA architectures, and is evaluated against state-of-the-art locking mechanisms and concurrent data structures.
Brahmaiah Gandham, Praveen Alapati, Aman Iftekhar· International journal of par...· 0 citations
Frontier open-weight models are increasingly available, but serving them still largely assumes datacenter infrastructure. We present FreeToken, an edge-native MoE serving system that treats a personal machine not as a small GPU, but as a unified, elastic inference platform. FreeToken co-designs the full serving stack,...
Shuo Yang, Xiao-yun Fan, Melissa Z. Pan et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
