I don’t think any of us have tried multi-gpu training yet with fastai v1 - at least no with nn.DataParallel. So there will probably be some code changes required. We’re unlikely to do them until after the course, so feel free to have a go yourself if you’re interested; and let us know if you try and get stuck at any point. Using pdb is probably going to help you figure out where the issues are.
6 Likes