Where is LanguageModelData?

Part 2 & Alumni (2018)
1

Maybe I am bit late to the party and this is solved somewhere, but, LanguageModelData is not a available in v1. I am wondering what is the equivalent to this in v1:

trn_dl = LanguageModelLoader(np.concatenate(trn_lm), bs, bptt)
val_dl = LanguageModelLoader(np.concatenate(val_lm), bs, bptt)
md = LanguageModelData(PATH, 1, vs, trn_dl, val_dl, bs=bs, bptt=bptt)

Cheers

1 Like
2

Hi!

What are train_lm and val_lm? In my case, when I had two pandas dataframes, I concatenated them into one dataframe, adding a fake column is_valid, and used datablock API to create a databunch.

3

I have the EXACT same doubt. @jeremy @sgugger , can you guys help here? In V1, how do we get a learner from trn_dl and val_dl ??