On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability
The architecture and the Muon optimizer together shift the optimal learning rate and batch size upwards, render batch-size warmup unnecessary, and substantially improve stability under stress tests.
Zi-Han Qiu, Ze-Kun Wang, Xiao Li et al.
· 42 citations
· ⚡7