It is argued that numerical format design is itself a first-class lever for stable FP4 training, and the first systematic study of FP4 LLM pretraining on energy-efficient Huawei Ascend NPUs is presented.
This work proposes AdaptCore, an adaptive framework for universally high-performance MatMul on Ascend NPUs, which systematically decouples operator optimization into spatial tiling and instruction orchestration and integrates a composable optimization library with a deterministic analytical performance model.
Yuhang Zhou, Jianglan Peng, Qian-Yu Jiang et al.· 0 citations
The quadratic cost of attention is a major bottleneck in diffusion-based video generation models. MXFP4 attention provides a promising path toward efficient inference, but direct MXFP4 quantization often degrades generation quality due to two numerical issues: the clipping-underflow trade-off from power-of-two scaling...
Jianlin Yu, Jing Lin, Linghui Kong et al.· arXiv.org· 0 citations
HiF4 is established as the enabling format for end-to-end FP4 RL post-training, and Rollout Residual Quantization (Rollout-ResQ) is established as the activation-side mechanism that makes the gap to BF16 closable.
H. Mak, Shadan Golestan, H. Le et al.· arXiv.org· 0 citations
This work proposes FIBER, a new architecture that extends the GPU SIMT (single instruction, multiple thread) model, and extends the ISA, microarchitecture, and compiler to realize shared-register addressing, conflict-free operand delivery, and fiber-based program mapping.
Zi-Han Liu, Jingwen Leng, Yang-Jie Zhou et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.