Trident: Unifying Guarded Dispatch and Host Execution for PyTorch Triton Workloads
User-written Triton kernels enable high-performance GPU computation within PyTorch, but their end-to-end latency can remain dominated by host-side orchestration, especially when device execution is short. Although torch.compile can generate native host wrappers for captured graphs, each invocation still passes through...
Jin-Jie Liu, Xiao-Yan Liu, Shu-Han Zhang et al.
· 0 citations