Skip to content

Author

Wei-Dong Han

We have 2 of 8 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Sep 2026

Function Over Form: Distributional Orthogonalization in Mixture-of-Experts with Replica Expert Mechanism

This paper proposes Distributional Orthogonalization Loss (DO-loss), an auxiliary regularization that shifts the focus from static weight diversity to dynamic routing behavior, and introduces the Replica Expert Mechanism (REM), which improves load balancing through a two-tiered strategy.

Jin-Fan He, Yun-Zhuo Liu, Kai Zhang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Hunyuan-A13B Technical Report

We present Hunyuan-A13B, an open-source large language model based on a Mixture-of-Experts architecture. It contains 80 billion total parameters but activates only 13 billion during inference, balancing model capability, computational efficiency, and deployment cost. The model is pretrained on a rigorously filtered 20T...

Tencent Hunyuan Team, Ao Liu, Bo Zhou et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.