Skip to content

Author

De-Jiang Zhu

We have 2 of 5 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Sep 2026

Semantics, Workflows, and Infrastructure: Understanding Agent Serving at Production Scale

A two-week trace of 11.7 million requests from a large-scale production platform for general-purpose agents, backed by inference infrastructure comprising over 10k GPUs is analyzed to characterize the platform at three connected levels: task-level initiation semantics, workflow-level execution patterns, and infrastruct...

Yi-Hao Zheng, Jing-Zhe Jiang, De-Jiang Zhu et al. · 1 citation · ⚡1
Sep 2026

PackServe: SLO-Aware Request Scheduling for Agentic LLM Serving at Scale

PackServe is a scheduler designed to reduce resource costs while meeting latency SLOs for agentic LLM serving, which uses compact white-box models to predict latency under prefill/decode interference and packs requests onto fewer serving instances while preserving KVC reuse and SLO constraints.

Zhi-Yuan Tan, De-Jiang Zhu, Jing-Zhe Jiang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.