I am trying a script that has a line
md = LanguageModelData(PATH, 1, vs, trn_dl, val_dl, bs=bs, bptt=bptt)
on running it, I get an error:
“NameError: name ‘LanguageModelData’ is not defined”
On looking at previous GitHub issues I discovered that this function was available only till v0.7 and has been removed in v1.0.x onwards. Is there a workaround to run codes that have used this function or an equivalent function that does the job of LanguageModelData?
I am using this function for the implementation of ULMFit, in the following code snippet:
trn_dl = LanguageModelLoader(np.concatenate(trn_lm), bs, bptt)
val_dl = LanguageModelLoader(np.concatenate(val_lm), bs, bptt)
md = LanguageModelData(PATH, 1, vs, trn_dl, val_dl, bs=bs, bptt=bptt)
where trn_lm and val_lm are numpy arrays.
I tried scouting the solution in the forum, but couldn’t find it. I’m new here hence unsure if I am creating the topic in the right category, can anyone help or provide any insights? thank you!