Skip to content

Author

Guodong Yang

We have 7 of 35 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Open access Oct 2026

The GPU Resilience Lottery: Understanding and Taming Real-World Hardware Errors in Heterogeneous AI Infrastructure

The booming LLM demand is driving a rapid increase in the scale and heterogeneity of modern AI infrastructure. To achieve high availability for sustained LLM workloads, infrastructure providers must contend with frequent and severe hardware errors. Without a holistic resilience understanding, providers may inadvertentl...

Xin-Kai Wang, Yun-Wei Li, Chao Li et al. · 0 citations
Preprint Sep 2026

KREX: Concurrent Kernel Benchmarking on Shared GPUs via Region-Granular Exclusivity

LLM agents automate GPU kernel optimization by repeatedly composing candidates and measuring their duration on real GPUs. Existing systems preserve measurement fidelity by reserving a GPU for an entire agent session or benchmarking command. However, this results in poor utilization because only a small fraction of comm...

Tian-Yu Feng, Hao-Xuan Yu, Tian-Yuan Wu et al. · 0 citations
Preprint Sep 2026

Capture the lifecycle: KV Cache management in ReAct Agents with KVTether

Efficient serving of long-context reasoning-and-acting (ReAct) agents relies on KV cache reuse to reduce large language model (LLM) prefill latency and monetary cost. However, a semantic gap exists between agent harnesses and the underlying serving stack. Through context mutation, tool execution, and subagent coordinat...

Kai-Hua Fu, Yu-Kun Zhou, Chaokun Chang et al. · 0 citations
Review Sep 2026

Herschel: Continuous Optimization of Production LLM Inference through On-Demand Profiling

Model-as-a-service platforms call for continuous optimization as complex serving conditions expose inefficiencies missed before deployment. Detailed always-on profiling can incur substantial overhead, while lightweight collection omits information needed for diagnosis. We present Herschel, a continuous optimization sys...

Lu-Ping Wang, Wei-Gao Chen, Yi-Fei Wu et al. · 0 citations
Sep 2026

Weave: Fine-Grained Dynamic SM Scheduling in an MoE Megakernel for Compute-Communication Overlap

Weave is presented, to the authors' knowledge the first MoE overlap system that performs fine-grained dynamic SM scheduling - deciding per layer and per GPU by routing results at runtime, and achieves a 2.89x geometric-mean MoE-layer speedup and a 1.33x geometric-mean end-to-end speedup over five state-of-the-art basel...

Zi-Yu Huang, Yang-Jie Zhou, Chen-Hao Zhu et al. · 1 citation · ⚡1
Jul 2026

Are LLM-Generated GPU Kernels Production-Ready? A Trace-Driven Benchmark and Optimization Agent

Atrex-Bench is presented, a benchmark whose 30 operators and 440 shapes are sampled directly from full-cluster production inference traces of compute-limited, memory-rich GPUs, and a profile-driven kernel-optimization agent that combines iterative measure-revise search, optimization dropout for escaping stalled search...

Ling-Yun Yang, Yuxiao Wang, Shenghao Liang et al. · 3 citations
Book Open access Aug 2026

From Nimitz to NetPila: The Evolution of Production-Scale Container Network

By embedding container addresses in the 128-bit IPv6 space, NetPila integrates the container network with the physical network, reducing packet-processing complexity and improving scalability.

Jiaqi Gao, Chao Qin, Sheng Cheng et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.