Skip to content

Achieving High-Performance Erasure Code Repair Through DPU Offloading

Aug 2026 · IEEE Non-Volatile Memory System and Applications Symposium · pp. 1-6 · 0 citations · 25 references

Abstract

Erasure coding provides efficient fault tolerance for large-scale distributed storage systems. However, its data repair process is well-known to be resource-intensive. We find that conventional host-centric, TCP-based repair architectures suffer from severe resource contention. Even in high-bandwidth networks, such interference slows repair operations and degrades service quality. To address this limitation, we propose DPUEC, a novel architecture that fully offloads the entire repair process to a Data Processing Unit (DPU). DPUEC leverages Remote Direct Memory Access (RDMA) to enable kernel-bypass data transfers and utilizes the onboard multi-core processors of DPU for highly parallel decoding. This design establishes a physically isolated data plane for repair traffic, completely bypassing host resources. Our prototype evaluation shows that DPUEC improves repair throughput by 133% - 181% over the state-of-the-art approach across different workloads. More importantly, DPUEC delivers true performance isolation. It eliminates any interference with foreground applications and reduces host CPU utilization on the recovery node to nearly zero.

View source

Similar papers

Book Open access Aug 2026

Spillway: Orchestrating DPU and Host into a Unified vSwitching Fabric

Spillway introduces a DPU-host hybrid data plane that repurposes idle host CPU resources to process spillover traffic when the DPU becomes the bottleneck, and decouples virtual switching capacity from static DPU hardware limits.

Xiaochong Jiang, Dian Fan, Yilong Lv et al. · 0 citations
Book Open access Sep 2026

DdlRT: A deterministic data layout for efficient redundancy transitioning in erasure-coded systems

Erasure coding is widely used in distributed storage systems because it provides high reliability with low storage overhead. To adapt to changing performance and reliability requirements, systems may perform redundancy transition on erasure-coded data, i.e., re-encoding existing data on the fly with new coding paramete...

Xiao-Tong Geng, Hao-Qi Duan, Liangliang Xu et al. · 0 citations
Book Open access Jul 2026

Copy2: Efficient Data Transfer in High Performance Environments

Preliminary results show up to twice the throughput of rclone with substantially lower energy usage, and successful migration of projects with hundreds of millions of files that would be impractical with existing tools.

A. Lambert, Deepa Panish · 0 citations
Preprint Aug 2026

OpScale: Operator-level Provisioning and Autoscaling for LLM Serving

OpScale is presented, a practical operator-level orchestration framework of profiling, provisioning, placement, and runtime serving that attains SLOs with up to 36.3% fewer GPUs and 28% less power, or achieves 44% higher throughput under fixed cost budgets.

Xingqi Cui, Chieh-Jan Mike Liang, Ziang T. Tang et al. · 0 citations
Book Open access Aug 2026

Efficient and Flexible Datapaths for Fine-Grained Rack-Scale Interconnects with Elastic QP

This work proposes Software-Interposed Datapath (SID), an efficient, software-flexible, and low-cost solution for rack-scale interconnects, particularly optimized for fine-grained memory access.

Chenxingyu Zhao, Yibo Wu, Hong-Tao Zhang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.