Skip to content
Conference

Empirical Evaluation of Nexuio: A Distributed Cache System for Petascale Analytics in the Cloud

Sep 2026 · IEEE International Conference on Cluster Computing · pp. 180-191 · 0 citations · 39 references

Abstract

Data-centric enterprises are migrating their analytic workloads from on-premises clusters to cloud object stores. While cloud storage offers elasticity and durability, it also introduces new overhead expenses (e.g., egress fees) and performance penalties (e.g., longer request latencies). To address these issues, we present Nexuio, a distributed cache system that bypasses conventional filesystem-style metadata operations to reduce both latencies and costs. It consists of two key techniques: (1) a page-based cache organization that avoids file operations (e.g., stat calls) by accessing data directly at the object level; and (2) a crossplatform runtime with zero-copy data transfer based on Arrow Flight. Nexuio can be integrated with various data analytics engines such as Presto and Velox to provide functionalities like failure handling, small-read optimizations, and skew mitigation. Deployed in a production system at Uber, Nexuio saves millions of dollars in GCS API cost, cuts egress traffic by 84.6%, and improves throughput by $4.4 \times \sim 8 \times$ compared to GCS gRPC clients. Lessons learned from empirical evaluation of Nexuio shed light on the deployment of petascale analytics in the cloud.

View source

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.