Change AWD_LSTM Parameter

If you want to update the params for the model you do it like this (here just to change to qrnn=True

config = awd_lstm_lm_config.copy()
config['qrnn'] = True

Then pass to the LM learner.

learn = language_model_learner(data_clas,AWD_LSTM, config=config)

Default params in AWD_LSTM config are here. They appear to match the paper except for the dropout probs (is that what you are focused on?)

Note if you change the fundamentals of the arch you will not be able to load pre-trained weights.

8 Likes