Lesson 4 In-Class Discussion ✅

[howkhang]

How to use multiple gpus

Thank you @sgugger . I did as you instructed and it worked. So just to recap (in case other people find it helpful), to train the RNNLearner.language_model with FastAI with multiple GPUs we do the following: Once we have our learn object, parallelize the model by executing learn.model = torch.nn.DataParallel(learn.model) Train as instructed in the docs Save the parallelized model learn.save('name') As instructed by @sgugger here, load the saved model, and strip out the word module from the…