Skip to content

Author

Dong Li

We have 2 of 25 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

SliMOO: Interpretable Multi-Objective Evolutionary Search for LLM Depth Pruning

As large language models (LLMs) grow more powerful, their scale makes them costly to serve. Depth pruning offers a practical route to efficiency by directly reducing memory and latency without hardware-specific support. However, we observe that transformer layers exhibit markedly different task-dependent layer contribu...

Guan-Chen Li, Yi-Xing Xu, Xuan-Wu Yin et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Training an MoE LLM in MXFP4: How We Closed the Gap to BF16

AlTO, an open-source training recipe for GPT-OSS-20B, a 20-billion-parameter mixture-of-experts (MoE) model, on the MLPerf Small MoE Training benchmark under the MXFP4 microscaling format is presented.

Han-Jing Wang, Zhi-Tao Wang, Natalia Frumkin et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.