On-policy distillation (OPD) has recently been introduced as a promising paradigm for continual learning, where a student policy can be supervised at the token-level. Typically, OPD is performed using a single teacher per prompt rollout (or even per training run). However, this ignores a whole other axis of flexibility...
Stanley Wei, Jiin Woo, Kaan Ozkara et al.· 0 citations
This tutorial presents emerging methods that leverage large language models (LLMs) to automate kernel generation for GPUs and custom accelerators such as AWS Trainium, and demonstrates how recent advances in reinforcement learning and inference-time compute scaling can be adapted to produce correct and performant kerne...
Youngsuk Park, R. Saha, Kaan Ozkara et al.· Proceedings of the 32nd ACM...· 0 citations
Writing high-performance system kernels for AI accelerators requires deep hardware expertise and low-level programming skill—a significant barrier for many researchers and engineers. This tutorial presents emerging methods that leverage large language models (LLMs) to automate kernel generation for GPUs and custom acce...
Youngsuk Park, R. Saha, Kaan Ozkara et al.· Proceedings of the 32nd ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.