REGEN: Replay-recycling for Expert-to-Generalist distillation with Offline Reinforcement Learning
REGEN completely decouples the rollout sampling from the backward training process and thus greatly reduces the training cost, and potentially turns online RL into a data synthesis process instead of a one-off learning stage, and can be extended to large-scale post-training without requiring heavy computational load.