Scaling Synthetic Pre-training Data and Evaluation for Indic LLMs
This work introduces Nemotron-Pretraining-Indic-v1, a synthetic pretraining corpus of approximately 2.83 trillion tokens covering all 22 scheduled Indian languages in native script and twelve in romanized form and introduces the Indic-LLM-Eval-Suite, a multilingual benchmark suite for evaluating Indic language models a...