NCCL (NVIDIA Collective Communication Library), NVIDIA multi-GPU communication library.
Reference links:
https://docs.nvidia.com/deeplearning/sdk/nccl-developer-guide/docs/index.html
NCCL (NVIDIA Collective Communication Library), NVIDIA multi-GPU communication library.
Reference links:
https://docs.nvidia.com/deeplearning/sdk/nccl-developer-guide/docs/index.html