User-written Triton kernels enable high-performance GPU computation within PyTorch, but their end-to-end latency can remain dominated by host-side orchestration, especially when device execution is short. Although torch.compile can generate native host wrappers for captured graphs, each invocation still passes through...
Jin-Jie Liu, Xiao-Yan Liu, Shu-Han Zhang et al.· 0 citations
SlideDP is presented, a synchronous data-parallel runtime for shared-host multi-GPU systems that maintains one authoritative host state, decouples communication routes from state layout, and pipelines parameter delivery, gradient aggregation, and CPU updates across ranks and chunks.
Rui-Jia Yang, Shi-Yuan Lin, Yu-Long Ao et al.· 0 citations
KernelGenBench is presented, the first unified multi-source and multi-chip infrastructure for evaluating LLM- and agent-generated Triton kernels and establishes operator source, hardware platform, and agentic scaffold as distinct dimensions of kernel-generation capability, and shows that success in a familiar source-ha...
Pei-Yu Zang, Jian-Hang Tao, Jia-Ling Zhang et al.· 0 citations
Large language models (LLMs) have significantly increased the demand for efficient accelerator kernels, but kernel development remains a highly specialized and labor-intensive task. The recent rise of LLMs and agentic frameworks offers a promising pathway toward automatic kernel generation. However, despite rapid progr...