To understand, look up a few Chinese blog simple to understand:
- How to understand the Multi-GPU multi-card communications framework NCCL Nvidia Nvidia?
- NCCL used for communication between the card NVIDIA GPU
- nvidia-nccl study notes
- https://developer.nvidia.com/nccl (official website)
- https://github.com/NVIDIA/nccl (official warehouse)
Excerpt:
Stay updated, more content, please refer cnblogs.com/xuyaowen;