Alexi Gladstone

Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation

This work introduces Explorative Modeling, a new paradigm that instead factors the training loop, exploring K candidate matches between model generations and data, and training on the best, so predictions commit to modes rather than blurring them, and establishes XMs as both a new pretraining axis for existing generati...