#artificial intelligence
Apr 2026
HiFloat4 Format for Language Model Pre-training on Ascend NPUs
It is argued that numerical format design is itself a first-class lever for stable FP4 training, and the first systematic study of FP4 LLM pretraining on energy-efficient Huawei Ascend NPUs is presented.
Mehran Taghian, Yun Peng, Xing Huang et al.
· arXiv.org · 3 citations