Frontier models, general-purpose and domain-specific alike, now include a midtraining stage between pretraining and post-training, but little has been published about how this stage is built. We present an open midtraining recipe that primes base models for agentic post-training, and we show its effectiveness on two Ne...
Soumye Singhal, Joseph Jennings, Ka-Shun Shum et al.· 0 citations
How can we predict which base checkpoint is worth an expensive round of agentic post-training? End-to-end pass@$K$ tests whether successful behavior already appears in a base model's distribution, but it is a poor fit for agentic coding: many base checkpoints cannot reliably produce the well-formed tool invocation requ...
Tan Yu, A. Bukharin, Khushi Bhardwaj et al.· 1 citation
PivotOPD, an on-policy distillation framework that jointly trains the student to prevent pivotal mistakes and to recover from the states they create, achieves the strongest average performance for both Qwen3-1.7B and Qwen3-8B students, and transfers to another model family on the software engineering domain.
Ying-Hui He, Ya-Pei Chang, Khushi Bhardwaj et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.