every blog every motto: You can do more than you think.
https://blog.csdn.net/weixin_39190382?type=blog
0. 前言
NNGT，
apex 安装实在是费劲，之前安装过一次，也是折腾了半天，奈何没有记录，这不又走一次老路，：）
安装过程中错误接着一个。。。 包括但不限于如下：
AttributeError: module ‘torch.distributed‘ has no attribute ‘_all_gather_base‘
cannot import name ‘amp‘ from “apex“ / from apex import amp
Warning: apex was installed without --cuda_ext
1. 正文
clone下来
git clone https://github.com/NVIDIA/apex
如果安装过了先卸载
pip uninstall apex
cd apex
如果有build，删除
rm -rf build (if it exists)
安装
python setup.py install --cuda_ext --cpp_ext
参考
[1] https://blog.csdn.net/hhhhhhhhhhwwwwwwwwww/article/details/128077560
[2] https://blog.csdn.net/weixin_59726951/article/details/127585754
[3] https://blog.csdn.net/qq_44741914/article/details/128087328
[4] https://blog.csdn.net/qq_42247018/article/details/115026338
[5] https://github.com/getalp/Flaubert/issues/13
[6] https://github.com/ptrblck/apex
[7] https://github.com/NVIDIA/apex/issues/86