STORM: Enabling Traffic Scheduling for RDMA

Simplifying Prioritization and Scheduling with P2CS

Evaluation on representative workloads demonstrates that P2CS achieves performance comparable to in-network mechanisms while significantly reducing complexity and cost, and requires minimal software changes making it readily deployable in today's datacenter infrastructure.

ProLet: Proactive Multi-path Load Balancing for Lossless RDMA

To achieve high-throughput and low-latency Remote Direct Memory Access (RDMA) communication in data center networks, load balancing is critical for preventing congestion and ensuring that traffic is efficiently distributed across available network paths. However, existing schemes may not effectively detect rerouting opportunities in continuous RDMA packet streams and may degrade in-order delivery, limiting their applicability to RDMA traffic. To address these limitations, we propose ProLet, a load balancing scheme that enables proactive probing and reroutes elephant flows at flowlet granularity in lossless RDMA networks. ProLet dynamically fine-tunes per-destination top-of-rack timeouts and enables effective in-network flowlet identification based on real-time network conditions. Meanwhile, it leverages lightweight mice flows as proactive probes to maintain network-wide congestion awareness. This allows ProLet to reroute elephant flows before congestion accumulates, mitigating the persistent queue buildup inherent in subflow-based schemes. Extensive numerical evaluations demonstrate that ProLet reduces average and tail flow completion time slowdowns by 69% and 79%, respectively, compared to state-of-the-art load balancing schemes.

MemExchange: Utility-Driven Distributed Memory Reallocation for Multi-Tenant Datacenters

Results show up to 2.3x lower remote-access overhead compared to TCP-based designs, a 13% increase in cluster-wide memory utilization at rack scale, and up to 63% reduction in miss rate for memory-constrained tenants under skewed workloads.

Performance Prediction of Data-Rebalancing Actions in Sharded NoSQL Clusters

A queueing network (QN) model of the rebalance process of the process used in MongoDB is developed, and a preliminary evaluation of performance prediction by the QN model via simulations is described, to understand the impact of different parameters of the rebalance process.

ARDA: I/O Scheduler for Heterogeneous Workloads Co-located on Ultra-low-latency SSDs

StrataCL: Fabric-Native Communication Library for Production Supernodes

Modern distributed AI workloads run across hundreds of accelerators, making communication a major bottleneck. Existing communication libraries remain largely buffer-centric because user and communication buffers are managed separately, causing redundant data copies or costly user-buffer registration. This paper presents StrataCL, a zero-redundancy and fabric-native communication library for production supernodes. StrataCL introduces registration-on-allocation to realize user-buffer direct communication, and designs communication operators with workload-balanced NPU-core partitioning and NPU-driven SDMA offloading to exploit supernode architecture features. On the Huawei CloudMatrix384, StrataCL improves collective bus bandwidth by up to 1.6x and improves MoE dispatch/combine bus bandwidth by up to 1.4x. Across three production workloads, StrataCL improves LLM inference throughput by 1.9x, reduces P99 TTFT by 2.2x, and reduces LLM and Recsys training iteration time by 1.4x and 1.3x, respectively.