[linux] warning:NCCL backend in DeepSpeed not yet implemented

NCCL backend in DeepSpeed not yet implemented · Issue #615 · microsoft/DeepSpeedExamples · GitHub

as far as I know. Deepspeed does not yet implement NCCL, but Deepspeed will use torch.distribute initialized by NCCL. In short, deepspeed does not implement NCCL, but torch does.