Open access
2026
Scalable Entity-Centric Data Filtration for LLM Pretraining
Large language models rely on scaling both model parameters and data, but increasing dataset size significantly raises computational and storage costs. While existing data filtering approaches remove low-quality or duplicated content, further refinement is needed to improve pretraining efficiency. This work introduces...
A. Asatryan, Olga Hovhannisyan, Ani Hayrapetyan et al.
· IEEE Access · 0 citations