Aug 2026· Proceedings of the VLDB Endowment· Vol 19, pp. 3847-3859· 0 citations· 47 references
TL;DR
WOP leverages the redo-flush path to push down write operations and enhances the storage layer for semantic-aware execution and supports high pushdown capacity with minimal memory footprint through Lightweight Metadata Tracking.
Abstract
While ByteDance's database infrastructure continues to serve bursty user traffic, emerging large-scale interactive applications generate increasingly write-intensive workloads spanning all stages of the data lifecycle. In production environments, we observe that these workloads are consistently bottlenecked by a common write-path inefficiency rooted in cache-miss-induced remote page fetches. In compute-storage disaggregated architectures, such remote page accesses introduce substantial I/O latency that dominates write performance. To address this bottleneck, we propose Write Operation Pushdown (WOP), a framework that eliminates Fetch-Before-Write (FBW) from the write path by pushing eligible writes to the storage layer for asynchronous execution. WOP leverages the redo-flush path to push down write operations and enhances the storage layer for semantic-aware execution. WOP supports high pushdown capacity with minimal memory footprint through Lightweight Metadata Tracking. WOP preserves correctness and consistency in distributed deployments via carefully designed mechanisms. To prevent read stalls introduced by asynchronous execution, WOP integrates a Fetch-After-Write (FAW) optimization with localized, on-demand replay. Across production workloads, WOP achieves up to 3.33× throughput improvement. On synthetic benchmarks, WOP improves throughput by up to 6.7× and reduces average latency by up to 85.2%. These results show that WOP significantly enhances write efficiency in industrial-scale workloads while preserving correctness in disaggregated deployments.
Modern heterogeneous storage no longer follows a simple fast/slow hierarchy. Byte-addressable NVM provides fine-grained, low-latency persistence, whereas NVMe SSDs deliver high bandwidth under deep queues and offer greater capacity. Most LSM-tree key-value stores, however, send every foreground write through a designat...
Rui-Song Zhou, Liang Bao, Hai-Jun Zhang et al.· Proceedings of the Internati...· 0 citations
Disaggregated memory architecture has gained wide adoption in cloud and high-performance systems [18, 31, 43] due to its decoupled resource model, elasticity, and low-latency access. In such architectures, transaction mechanisms must ensure atomic and consistent access to remote memory. Prior designs use array-based ve...
Ao-Xin Wei, Jin-Tian Wu, Jian Zhou et al.· Proceedings of the Internati...· 0 citations
Zoned Namespace (ZNS) SSDs expose a sequential-write zone interface that reduces flash-level write amplification and offers cost and capacity advantages over conventional SSDs. Yet this interface creates a semantic mismatch for B+Tree-based storage engines, whose updates are fine-grained and logically in-place. Our wri...
Bo Chen, Jin-Lei Hu, Cheng-Xiao Gong et al.· Proceedings of the Internati...· 0 citations
LLM-based applications increasingly rely on persistent state stores to maintain durable memories across long-running interactions. Unlike conventional storage systems, these stores often invoke LLMs on the write path to transform raw context into semantic state, shifting maintenance cost from bytes written to tokens pr...
Shi-Jun Yang, Shu-Heng Gao, Chao Yan et al.· Proceedings of the 18th ACM...· 0 citations
A Lightweight Cache Buffer Management (LCBM) strategy that avoids precise frequency tracking altogether and reduces the average read latency and the write response time, while eliminating the metadata overhead of counter- and LRU-based designs is introduced.
Log-Structured Merge-tree (LSM) aims to achieve high write throughput, but is known to experience the write stall problems when subjected to sustained write pressure. We quantify the occurrence probability and average duration of write stalls in LSM using a queuing model in the write--flush--compaction pipeline, moving...
Hongsu Byun, Safdar Jamil, Honghyeon Yoo et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.