This may be a bit late but there are now 2 options available from AWS to this problem.
- NVIDIA provides some pre-built AMI’s on the marketplace that could be used insted (https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/accelerated-computing-instances.html#gpu-operating-systems)
- OR Install the correct NVIDIA drivers yourself. The process takes about 10 min with rebooting but I had a working GPU instance afterward. Follow the step by step instructions here (https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/install-nvidia-driver.html). Afterward you could also tune the drivers to your instance type (https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/optimize_gpu.html)