Author

Zhiyi Yao

h-index 1 View on Semantic Scholar

We have 3 of 8 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Fast and Memory Efficient Offload Training Framework with Hybrid XPU Computation

With the ever-growing size of deep learning models, GPU memory is prone to being insufficient during training. A prominent approach is ZeRO-Offload, which moves the optimizer states to CPU memory and performs parameter update using CPU. However, the deficiencies of ZeRO-Offload include low GPU utilization, imperfect ov...

Zhi-Yi Yao, Zu-Ning Liang, Yue-Dong Xu et al. · 0 citations

2026

An Efficient Computing and Communication Framework for Large-Scale Data Processing Cluster

Data processing clusters dealing with big data are facing extended completion times for jobs because the RDMA feature is not being used efficiently. Our production data from a large cluster, which has many server nodes and is responsible for processing extensive data jobs, reveals that the current use of the RDMA techn...

Xuya Jia, Zhiyi Yao, Chao Peng et al. · IEEE Transactions on Network... · 0 citations

Jul 2026

DualDecoder: Accelerate Long Context LLM Inference by Predictive Prefetch

DualDecoder is presented, a lightweight serving system for long-context LLM inference that enables efficient sparse KV cache retrieval from host memory that leverages a novel dual-token decoding pipeline that accurately identifies critical KV entries with negligible computational overhead.

Zuning Liang, Zhiyi Yao, Qi Chen et al. · arXiv.org · 1 citation