Accelerating Reinforcement Learning Weight Refit with the Reshard Collective

NVIDIA's NCCL M2N Reshard, an open-source reference implementation of a new collective, targets RL weight refit, the step where updated parameters move from training GPUs to inference GPUs.