Haibo Chen

Characterizing CPU-GPU Memory Sharing over Unified Memory Architecture

Unified Memory Architecture (UMA) enables the CPU and GPU to share a single physical memory. However, its complexity and opacity often drive applications back to inefficient copying or to incorrect direct access that sacrifices performance or even correctness. This paper presents a comprehensive study of CPU-GPU memory...

Preserving GPU Profiling Accuracy under Concurrent GPU-Coding Agent Workloads

Efficient K-generalizable Learned Search

This paper shows that learned search can support arbitrary K with the preprocessing cost of a single top-1 model, and reduces total serving and preprocessing computation by up to 28%.

SMetric: Rethink LLM Scheduling for Serving Agents with Balanced Session-centric Scheduling

SMetric addresses session-centric scheduling with differential scheduling based on two indicators derived from the request itself, the session turn and the local KV\$ hit: it schedules first-turn requests for load balance, and sticks follow-ups to the instance with the highest local hit for high KV\$ reuse.