Author

Yun-Zhuo Liu

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Sep 2026

Function Over Form: Distributional Orthogonalization in Mixture-of-Experts with Replica Expert Mechanism

This paper proposes Distributional Orthogonalization Loss (DO-loss), an auxiliary regularization that shifts the focus from static weight diversity to dynamic routing behavior, and introduces the Replica Expert Mechanism (REM), which improves load balancing through a two-tiered strategy.

Jin-Fan He, Yun-Zhuo Liu, Kai Zhang et al. · 0 citations