AutoLiquid: Autonomic Data Layout Optimization for the Databricks Lakehouse
This work presents AutoLiquid, an autonomic system that solves the tension between adapting to unpredictable workloads and maintaining strong performance guarantees against regressions by continuously selecting, verifying, and applying clustering keys for Liquid Clustering tables, requiring only a single "CLUSTER BY AU...