You need to install a plug-in
https://github.com/NVIDIA/k8s-device-plugin#enabling-gpu-support-in-kubernetes