Pretrain MLM and fintune on GLUE with fastai - 2 - TextDataloader for sliding window over sentences or tokens

[Richard-Wang]

=== 2020.05.21 ===

1. Load cache with different args
   When loading cached TextDataloader, you can change setting for TfmDL, such as bs, before_batch …, and also some of TextDataloader (sort_by_len,…). Also it will tell you when you try to change invalidly.
   

   

2. Loading bar
   Now you won’t be worried about if there is bug but know that it was just need more time.