What changes to do when I shift to multi-GPU setup?

(Kushajveer Singh) #1

I have started using Google credits to work on GCP. I currently use a single GPU but would be using multi GPU after some time.

So I wanted to know what things to change in my code. Are there are best practices when using multi-GPU that I should be aware of?

Setup:-

  • Google Cloud Platform
  • PyTorch + fastai
0 Likes