Zhiyuan Yan

LiveResize: Runtime GPU Reallocation for Disaggregated LLM Post-Training

RL-based LLM post-training increasingly disaggregates rollout and training across separate GPU resources, but static GPU partitioning can suffer from pipeline bubbles under long-tail rollout latency. We present LiveResize, a runtime GPU reallocation system that dynamically switches GPUs between rollout and training to...