Troubleshooting my Hardware

[willismar (Willismar Medeiros)]

To use Multiples GPU first we need to wrap the model on DataParallel. But will also lead to another problem. Overheat of one of the GPUs.

You can read more about this behavior between PyTorch and DataParallel on this Blog:

https://medium.com/huggingface/training-larger-batches-practical-tips-on-1-gpu-multi-gpu-distributed-setups-ec88c3e51255

Also take a look on the reply of professor @jeremy about Multi-GPU.

How to use multiple gpus

I don’t think any of us have tried multi-gpu training yet with fastai v1 - at least no with nn.DataParallel. So there will probably be some code changes required. We’re unlikely to do them until after the course, so feel free to have a go yourself if you’re interested; and let us know if you try and get stuck at any point. Using pdb is probably going to help you figure out where the issues are.