FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing
FineWeb-CLaR is introduced, a large-scale annotated dataset derived from FineWeb and FineWeb-2 that places web documents on a shared culture-language-region axis for corpus auditing and benchmark alignment, enabling direct comparison between corpus-side pretraining evidence and benchmark-side evaluation coverage.
Yusser Al Ghussin, Eva Gavaller, Cristina España-Bonet et al.
· 0 citations