0、NVIDIA CUDA-X AI
NVIDIA CUDA-X AI is a complete set of deep learning software
Official website: https://developer.nvidia.com/deep-learning-software
https://github.com/NVIDIA: NVIDIA products, demos, samples, getting started tutorials
1. Deep learning training
Deep Learning Training
1.1、DALI
The Data Loading Library (DALI) is a GPU-accelerated data augmentation and image loading library for optimizing data pipelines of deep learning frameworks.
1. 2、cuDNN
CUDA Deep Neural Networks (cuDNN) is a high-performance library with building blocks for deep neural network applications, including deep learning primitives for convolutions, activation functions, and tensor transformations.
1. 3、NCCL
NVIDIA Collective Communications Library (NCCL) accelerates multi-GPU communication with routines, such as all-gather, reduce, and broadcast, that scale up to eight GPUs.
1. 4、NeMo
NVIDIA Neural Modules (NeMo) is an open source toolkit for building state-of-the-art neural networks for AI-accelerated speech and language applications.
1. 5、PEOPLE Toolkit
T