M2K: Making the Model-Kernel Interface Explicit for Reliable CUDA Kernel Verification
M2K is presented, a fully automated framework that makes the model-kernel interface explicit and leverages it to detect memory bugs in CUDA kernels used in LLM inference systems, and discovers 181 previously unknown bugs in real LLM inference systems.
Mengting He, Shihao Xia, Haomin Jia et al.
· 0 citations