G. Varoquaux

TabICLv2: A better, faster, scalable, and open tabular foundation model

TabICLv2 is introduced, a new state-of-the-art foundation model for regression and classification built on three pillars: a novel synthetic data generation engine designed for high pretraining diversity, various architectural innovations, and optimized pretraining protocols, notably replacing AdamW with the Muon optimi...