Skip to content

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

HiFloat4 Format for Language Model Pre-training on Ascend NPUs

It is argued that numerical format design is itself a first-class lever for stable FP4 training, and the first systematic study of FP4 LLM pretraining on energy-efficient Huawei Ascend NPUs is presented.

Mehran Taghian, Yun Peng, Xing Huang et al. · 3 citations
#machine learning Preprint Aug 2026

TrainSDC: Characterizing and Mitigating Silent Data Corruption in Large Language Model Training

This work presents the first systematic characterization of SDC vulnerability across major computation interfaces in both the forward and backward passes of Transformer training, and proposes TrainSDC, a characterization-guided protection framework consisting of Q/K-path recomputation, residual-gain monitoring, and exp...

Zhijie Xia, Haotian Xu, Si-Yu Yun et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.