I found lesson 4 to be incredibly interesting but there’s something I’m not really sure about when it comes to use the wikiText103 pretrained dataset.
In the notes
we can see how the learner for the language model is initialized this way
learn = language_model_learner(data_lm, pretrained_model=URLs.WT103, drop_mult=0.3)
while in the notebook we find the same line in this form
learn = language_model_learner(data_lm, AWD_LSTM, drop_mult=0.3)
what is exactly going on?
Are we using the WT103 or not?
I can’t see any file being downloaded and when I try to substitute the AWD_LSTM with pretrained_model=URLs.W103 I get a Key Error
Thanks for stopping by, hopefully somebody could clarify that for me