I’ve been trying to search the original ULMfit code that was used to train the LM that got publihsed in the paper.
I just get refered everywhere to Jeremys 2018 DL foundations video series for ULMfit.
However I found out that many implementations like STLR, Discriminative fine tuning etc aren’t implemented there . I feel like it’s the demo version of ULMfit. And the not the original model with all the actual hyperparams that actually broke all sota back in its day.
Also in the end Jeremy scrolling through the code also mentions that this isn’t the actual ULMfit model. The actual one was training differently
Can someone link me the actual ULMfit code that was actually used to publish the paper