Skip to content

Rufus-Air: An Open LLM Post-Training Recipe

Sep 2026 · arXiv.org · Vol abs/2609.29421 · 1 citation · 121 references
Computer Science

TL;DR

The main findings are that diverse, high-quality SFT establishes a strong capability floor and difficulty filtering keeps RL prompts within a productive learning range, and reward reliability provides a practical principle for ordering stages.

Abstract

Rufus-Air is an open and reproducible post-training recipe on GLM-4.5-Air-Base (106B-A12B), organized as a serial pipeline of eight stages: SFT, Reasoning RL, Coding RL, Instruction-Following RL, General Agent, Coding Agent, Search Agent, and RLHF. We document the data, reward design, infrastructure, stage order, and stagewise results needed to reproduce the recipe. Stages progress from basic to advanced capabilities and from hard, verifiable rewards to softer judge-based signals. Training builds on open-source components and public data, much of it used as released, without new human annotation or an in-house distillation teacher. Our main findings are that (i) diverse, high-quality SFT establishes a strong capability floor; (ii) difficulty filtering keeps RL prompts within a productive learning range; (iii) reward reliability provides a practical principle for ordering stages; and (iv) infrastructure and engineering choices are part of the recipe, not just an implementation detail. Rufus-Air improves over the official GLM-4.5-Air post-trained release and is competitive with similarly sized open models.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Understanding the Synergy between SFT, RLVR, and OPD in LLM Post-Training

This work characterize OPD across nine student-teacher pairs spanning 2x to 53x parameter ratios and shows that OPD effectiveness depends on student-teacher compatibility rather than teacher scale alone, and suggests that each post-training stage should be chosen not only for the capability it adds, but for the learnin...

Emre Can Acikgoz, Yang Li, Z. Liu et al. · 0 citations
#machine learning Preprint Sep 2026

Miles v0.1: Production-Level Post-Training

Miles v0.1 is presented, a full-stack, production-ready system for frontier post-training reinforcement-learning training, which supports LoRA RL, on-policy distillation, supervised fine-tuning, and true-on-policy rollout-training alignment, and extends the same architecture to diffusion models.

R. Chen, Ma Cheng, Shi Dong et al. · 1 citation

OpenJev-RLCD: A Working RLCD Implementation

Decision models such as Jev answer questions with probabilities, which are only useful if they are calibrated. Open-source reproductions rely on supervised fine-tuning plus temperature scaling, while reinforcement learning from verifiable rewards (RLVR) makes reasoning models overconfident. We present a working impleme...

Zhi-Min Gao, Pi-Chao Wang · 0 citations
#artificial intelligence Preprint Oct 2026

OPD Before RL: Warm-Starting Rubric-Based RL with On-Policy Distillation

Many useful language-model tasks cannot be evaluated by exact outcome verification. Rubric-based reinforcement learning (RL) addresses this issue by scoring open-ended responses against explicit criteria. However, because the reward is assigned after the complete response, the training signal does not directly identify...

Xinpeng Wang, Wei-Han Shi, Yu-Chia Chen et al. · 1 citation
#artificial intelligence Preprint Oct 2026

A Sovereign, Indic-First, Reasoning Model

Gnani-Evon-v3.3-30B-A3B is a long-context hybrid Mamba-Transformer mixture-of-experts model for reasoning, instruction following, and tool use in English and eight Indian languages. Starting from NVIDIA's Nemotron-3-Nano-30B-A3B checkpoint, it retains the 52-layer backbone and changes the vocabulary, training data, and...

Sutanshu Saksena Raj, Prasanjith Pasunuti, Parijat Chatterjee et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.