Long-Range Distillation: Distilling 10,000 Years of Simulated Climate into Long Timestep AI Weather Models
Long-range distillation is introduced, whereby a long-timestep probabilistic ``student''model is trained to forecast directly at long-range using a huge synthetic dataset generated by an autoregressive ``teacher''model, representing the first demonstration that real-world skill can be improved by training on AI-generat...