A Declarative-Procedural Perspective on Expert Routing in Bilingual Mixture-of-Experts Language Models
Results suggest that interpretable linguistic organization emerges within MoE routing patterns even without sequential language exposure, and suggest that staged bilingual exposure reduces single-language dominance.
Amrit Gopinath, Raghul, D. Thenmozhi
· 0 citations