I will publish the code this week. It will work with the last changes of fastai v1.
For french corpus, the simplest is to start with wikipedia FR (more information on how to extract in the LM zoo topic: Language Model Zoo 🦍).
2 Likes