Textdatabunch gets stuck

Part 1 (2019)
1

TextDataBunch gets stuck when making language model databunch
It does not proceed further at all. Can anyone please point me to what could be the issue?

Stuck
Stuck.PNG1378×293 19.3 KB

2

The problem occurs in the labeling for language model part.

Stuck-detail
Stuck-detail.PNG1106×222 8.79 KB

3

What happens when label_for_lm() is called?
This is where your training and validation ItemLists are created using your pre-processing function responsible for tokenizing your text, building (or applying) your vocab, and numericalizing your tokens based on that vocab.

Looking at the code, you’ll notice that the progress bar pops up during the tokenization process … and so I’m inclined to believe, that for some reason, the tokenizer is having problems with your training dataset (ItemList).

Some things to try:

  1. Review your .csv file and make sure all looks kosher

  2. What happens if you change your random split pct? For example, try splitting it by 0.5 … what happens then?

  3. And make sure you have the latest version of fastai (I think its 0.39). You can check by including the following in your notebook

print(f'fastai version: {__version__}')