Pytorch implementation of ULMFit

I am curious if anyone has seen a purely Pytorch implementation of ULMFit, i.e. without going through fastai. I think it would be very educational, but was wondering if anyone has done it.

Check out the fastai source code of AWD-LSTM in PyTorch:

Or the original PyTorch code of AWD-LSTM from Salesforce Research:

And I highly recommend lesson 12 from course 2019 part 2 which shows how to code ULMFiT from scratch: