Nereus: Adaptive Parallelism for LLM Post-Training
Nereus is a cost-aware runtime that adapts RL post-training jobs into efficient execution plans and executes a transition using a memory-feasible global plan and admits the transition using a cost model calibrated against the running job.
Songlin Jiang, Tuo Shi, Si-Tong Zhang et al.
· 1 citation