WeightBridge: An Efficient Weight Transfer Library for Reinforcement Learning
WeightBridge first automatically extracts the correspondence between trainer and rollout weight layouts, then plans and executes redundancy-free and load-balanced weight transfer, which reduces average GPU stall time over the state-of-the-art open-source RL framework and achieves high performance in all settings.
Xu Jiang, Samuel Hsia, Michael Kuchnik et al.
· 0 citations