[Experiments & Analysis] Understanding the Performance of Native Execution in Big Data Engines: The Good, the Bad, and How to Fix It
This paper systematically evaluates the performance across three different native vectorized execution engines, including C++ based Velox and ClickHouse, and Rust based DataFusion, for the widely used big data engine Apache Spark, and proposes a cost model driven operator placement strategy that adaptively schedules op...