Skip to content
Log in
Sponsored AI AM CLAUDE, A Beginner's Guide: Learn the basics of working with AI AI AM CLAUDE, A Beginner's Guide: Learn the basics of working with AI

Finding NEMO: Nimble and Expressive Memory Observability

Shi-Hang Li Matthew Giordano Tushar Garg Rohan Kadekodi Daniel S. Berger Baris Kasikci Thomas E. Anderson Simon Peter Microsoft Azure
· 1 citation · 72 references

TL;DR

NEMO is presented, a nimble and expressive hardware memory telemetry engine for server memory controllers (MCs) that gives OS subsystems policy-specific views of memory behavior and provides higher-fidelity signals at substantially lower CPU overhead across a range of state-of-the-art memory management systems.

Semantic Scholar
View source

Similar papers

Book Open access Aug 2026

Beyond Monoliths: Enabling Flexible and Composable AI Systems via Memory Disaggregation

CAISA is introduced, a composable AI systems architecture that enables disaggregated memory expansion for large-scale AI workloads using CXL-based shared memory and coupling memory isolation with software-managed data orchestration decouples compute and memory resources while preserving efficient data movement, providi...

Divya Kiran Kadiyala, Lianjie Cao, Jinsun Yoo et al. · 0 citations
Preprint Sep 2026

xTier: Intelligent Tiering for CXL-Enabled Memory

CXL-enabled memory expands server memory capacity, but introduces a page-placement problem: the operating system must decide which pages should reside in DRAM and which should reside on slower CXL memory. Existing systems make this tradeoff in one of two ways. Userspace controllers support flexible policies, but expose...

Sriranga Ramaswamy, Yue-Qi Chen · 0 citations

HostPIMSim: A High-Productivity Framework for Host-Side Processing-in-Memory Simulation

Results show that standardizing the host-interface layer reduces both the engineering cost of PIM simulator development and the energy overhead of simulation-driven workload evaluation, while reducing host CPU utilization and package energy by up to 50% on transfer-intensive workloads.

Jinyong Min, Bernhard Egger · 0 citations

of the 24th USENIX Conference on File and Storage Technologies

SolidAttention is introduced, an LLM inference engine which addresses limitations through a tight co-design of dynamic attention sparsity algorithms and SSD-based storage management and minimizes SSD-induced blocking latency.

Xin Zheng, Dong-Liang Wei, Jian-Xiang Gao et al. · 0 citations
Book Open access Sep 2026

MCSched: Memory-Controller-Aware Scheduling for Embodied LLM Workloads on NVIDIA Jetson

Preliminary but compelling evidence that MC-aware scheduling is a practical operating system/runtime direction for deployable embodied AI on unified memory edge devices is provided.

Teng Mei, Cheng-Xuan Pei, Marco Canini et al. · 1 citation
Book Open access Aug 2026

Dorado: Scaling SmartNIC Session Tables on Commodity DDRs

Dorado is a novel design that scales SmartNIC session tables entirely on inexpensive DDR modules and uses three new techniques that extract commodity DDR performance by restructuring session table layout, decomposing processing pipelines to reduce locking, and scheduling memory accesses to minimize stalls.

Heng Yu, Kai Ren, Jiajun Liang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.