Author

Xue-Hai Zhou

h-index 7 View on Semantic Scholar

We have 6 of 75 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

Beacon: LLM Multi-Agent Driven Hardware Design Space Exploration for Heterogeneous Multi-Chiplet Deep Learning Accelerators

Heterogeneous multi-chiplet accelerators allow chiplets to be configured independently to better match different operator characteristics and improve inference efficiency. However, heterogeneity makes simulator evaluation expensive, limiting the number of iterations affordable for hardware design space exploration (HW-...

Bo-Yu Li, Zongwei Zhu, Qianyue Cao et al. · 0 citations

#artificial intelligence Preprint Sep 2026

ActKV: Efficient LLM Agents through Action-Guided KV Cache Management

This work proposes ActKV, the first KV cache compression framework tailored for agentic LLM inference, and establishes a compression criterion that values KV entries by their contribution to action generation and prioritizes action quality.

Zi-Han Wang, Cheng Tang, Lei Gong et al. · 0 citations

#machine learning Jan 2026

Window-Diffusion: Accelerating Diffusion Language Model Inference with Windowed Token Pruning and Caching

The token-level analysis reveals pronounced structural locality in DLM inference, and proposes a window-based token pruning and caching method for inference that achieves up to $99\times inference speedup while largely preserving generation performance.

Feng-Rui Zuo, Zhiwei Ke, Yi-Ming Liu et al. · Advanced Parallel Programmin... · 3 citations

#artificial intelligence Preprint Sep 2026

SeqMoE: Toward Full-Load Performance via Predictive and Graph-Compatible MoE Offloading

This work is the first to recast expert activation prediction as sequence modeling, enabling accurate multi-step, multi-layer forecasts that provide a long and reliable window for downstream decisions, and derives general runtime principles encompassing compute-transparent expert placement and synchronization-free orch...

Zi-Han Wang, Yu-Qi Wang, Lei Gong et al. · 0 citations

Preprint Aug 2026

UnionSparse: An Index-Efficient Sparsity Framework for Low-Bit Sparse LLM Inference on Edge

Under W4A4 quantization and 30%--70% sparsity, UnionSparse outperforms FlashLLM and SpInfer by 2.30x and 1.43x, and CUTLASS and cuBLAS Tensor Core by 1.56x and 3.46x, respectively.

Tianhao Jiang, Hang Gu, Teng Wang et al. · 0 citations

Open access Jul 2026

Realizable N:M Sparse Transformer Inference via Search-Kernel Co-design

This work designs MD-SpMM, an N:M sparse CUDA kernel that reorganizes sparse GEMM into micro-dense, Tensor-Core-aligned dataflow and uses inference-aware adaptive parallelism to sustain utilization and performs layer-wise sparsity search under explicit end-to-end latency budgets.

Yi-Ming Liu, Wenqi Lou, Zhiguang Wang et al. · European Conference on Paral... · 0 citations