We present Hunyuan-A13B, an open-source large language model based on a Mixture-of-Experts architecture. It contains 80 billion total parameters but activates only 13 billion during inference, balancing model capability, computational efficiency, and deployment cost. The model is pretrained on a rigorously filtered 20T...
Tencent Hunyuan Team, Ao Liu, Bo Zhou et al.· 0 citations
PerSyn (Personalized data Synthesis), a novel synthesis strategy that operates under a new ``Route then Generate''paradigm to create data tailored to each student model, enabling it to learn more effectively, is proposed.
Hengyuan Zhang, Shi-Ping Yang, Xiao Liang et al.· Annual Meeting of the Associ...· 21 citations
DIEM is proposed, a principled and fully automated framework that makes data utilization adaptive throughout RFT and consistently outperforms strong static and dynamic baselines.
Haoru Tan, Sitong Wu, Yan-Feng Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.