Author

Siyu Ding

h-index 5 View on Semantic Scholar

We have 1 of 12 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Jul 2026

Full-Stack FP4: Stable LLM Pretraining with Quantized Projections, Optimizers, and Attention

Full-Stack FP4 is presented, a modular NVFP4 framework with separate recipes for projections, AdamW states, Root/Muon computation, and attention, and mixed-precision attention that protects a compact projection subspace in BF16 while retaining full-shape NVFP4 computation.

Siyu Ding, Ming Ma, Jiabo Tong et al. · arXiv.org · 3 citations