Cleave: Scaling Tensor Program Optimization via Decoupled Algebraic Search and Operator Scheduling
Optimized kernels such as FlashAttention and FlashDecoding are crucial for accelerating today's large models. Most of them are handwritten by experts because existing ML compilers cannot match their efficiency. Producing such kernels requires fusing computations with multiple reductions, which requires both algebraic t...
David Pissarra, Jinkun Lin, Hai-Tian Jiang et al.
· 0 citations