Scaling Laws for Multimodal Data Mixtures
Frontier AI systems are increasingly natively multimodal, jointly pretrained on multiple modalities, such as text, vision, and audio. However, the scientific understanding of the multimodal data mixtures used to pretrain these systems --- how much of each modality to mix, and at what potential interference cost to the...
Aditi Khandelwal, A. Tarun, Yi-Xuan Xu et al.
· 0 citations