FastHugs - fastai-v2 and HuggingFace Transformers

Hello Morgan. I found the corrections to be made in your notebook 2020-04-24-fasthugs_language_model.ipynb. Please check the following 5 screenshots:

  • fastai: 2.0.8
  • fastcore: 1.0.1
  • pytorch: 1.6.0
  • python: 3.8.2
  • tokenizers: 0.8.1rc2
  • transformers: 3.1.0

import fastai

fasthugstok

class MLMTokenizer()

fastai_tokenizer

transformer_mlm_padding()

5 Likes