I recall Jeremy doing an interesting demo where he created a new document from just a few keywords by using a pre-trained language model fine tuned with a large corpus of academic document abstracts. I can’t find it in the course material. Can someone please let me know which lesson that was in and, ideally, if there was a demo notebook? I’ve looked at all the 2018 course #1 and #2 notebooks and can’t find it.
The demo results looked something like what might be produced by OpenAI’s gpt-2. I want to fine tune a ULMFit model with my own corpus.