GPU Goldmines: Tunable WebGPU Kernels for Edge LLM Inference
This work presents GPU Goldmines, a framework for specifying, executing, and tuning WebGPU kernels with kernels for key LLM building blocks: matrix multiplication, matrix-vector multiplication, and flash attention, and characterize performance across diverse devices, shapes, and browsers.
Rithik Sharma, Reese Levine, Zhe-Yuan Chen et al.
· 0 citations