The Tensor Memory Accelerator (TMA), introduced on NVIDIA Hopper, is used pervasively in production GPU kernels yet its usage is conspicuously selective: expert kernel developers in CUTLASS, FlashAttention-3, and FlashInfer apply TMA to some tensor operands within a kernel but fall back to cp.async, direct global loads...
Christin Bose, Cesar Avalos Baddouh, Jun-Rui Pan et al.· IEEE International Symposium...· 0 citations
This work presents a cycle-level simulation framework designed to accurately model modern GPU generations, including Ampere, Hopper, and Blackwell, and conducts architectural case studies to evaluate emerging design trajectories, including chiplet topology scaling, expanded SRAM capacity and bandwidth, and inter-GPU pr...
Junrui Pan, Wei-Li An, Cesar Avalos Baddouh et al.· 2 citations· ⚡2
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.