Data-Efficient Language Modeling: From Frontier Advancement to Principle-Guided Model Improvement
Learning from limited text requires models to use context, generalize to new inputs, and retain useful capabilities. Qiushi Engine conducted a long-horizon, end-to-end autonomous research program on BabyLM 2026 Strict-Small, within 10 million corpus words and 100 million cumulative word presentations. Three stages conn...
Shu-Xing Yang, Kai-Hao Zhu, Jun-Jie Yang et al.
· 0 citations