Can the fastai.distributed library be used with an RNN

fastai
1

I see the examples with a cnn learner, but could I train a language model on 8 GPU’s using the distributed library?

Thanks

2

You’ll get a bug with the RNN, specifically the language model, since the dataloader behind the scenes isn’t a real dataloader and thus doesn’t take a custom sampler. I’ll try to fix it soon.

3

Sounds good and thanks for your support!