Teaching LLMs to Write System Kernels for AI Accelerators: Post-Training, Reasoning, and Agentic Optimization
This tutorial presents emerging methods that leverage large language models (LLMs) to automate kernel generation for GPUs and custom accelerators such as AWS Trainium, and demonstrates how recent advances in reinforcement learning and inference-time compute scaling can be adapted to produce correct and performant kerne...