Two ways of multi-GPU training in pytorch

Method 1: Single-machine multi-card
Method 2: Multi-machine multi-card
In fact, GPU training in pytorch and tensorflow is particularly simple. Only two or three lines of code are needed to implement
GPU training. Two ways of GPU training in pytorch version: https: // oldpan.me/archives/pytorch-to-use-multiple-gpus
GPU training method of tensorflow: https://blog.csdn.net/nbxuwentao/article/details/103571594