Author

Zihan Qiu

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

ID Balancing: Stable Training of Extremely Sparse MoE via PID-Based Load Control

Scaling Large Language Models (LLMs) via Mixture-of-Experts (MoE) enables massive parameter growth with nearly constant per-token computation. However, further scaling the parameter count requires increasingly sparse routing, where expert load imbalance becomes more severe. This imbalance reduces parameter utilization...

Peng Jin, Zi-Han Qiu, Ze-Kun Wang et al. · 0 citations

#natural language process... Preprint Aug 2026

On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability

The architecture and the Muon optimizer together shift the optimal learning rate and batch size upwards, render batch-size warmup unnecessary, and substantially improve stability under stress tests.

Zi-Han Qiu, Zekun Wang, Xiao Li et al. · 20 citations · ⚡2