Sentiment analysis for IMDB reviews - ULMFit Process on a picture

Part 1 (2019)
1

I just wanted to share a diagram I did to visualize what is done in the notebook


and also on the NLP course

900Ă—567 139 KB

I find a simple drawing convenient to explain the code.

Made on tablet using https://www.lekhapp.com/ (free)

1 Like
2

Great idea to put the whole ULMFit process into one picture!

Maybe one thought for improvement:

  • on the left side (language model) you actually load architecture + weights from the pretrained AWD-LSTM, so I guess “Model” would be more exact than “Architecture”
  • on the right side it’s correct that you only take the AWD-LSTM architecture and then load in the weights from your fine-tuned encoder. So technically you don’t even load the architecture from a pre-trained model but only specify it as AWD-LSTM (i.e. you can even set pretrained=False here)