ULMfit implementation in Tensorflow?

(Otto Stegmaier) #1

Has anyone attempted to implement ULMFit in TensorFlow? If so, please share! Otherwise, let me know if anyone’s interested in collaborating on an attempt.

(Samuel) #2

I think the best way to use ULMFiT in Tensorflow is to store the pre-trained model in tensorflow hub.

(Otto Stegmaier) #3

@Samuel - that’s a great option - do you know if anyone has created a TF Hub module for ULMFit?

While that would be great as an option - I was hoping to read through an implementation the model from start to finish for both educational purposes and to train on a different corpus.

(marc) #4

https://www.tensorflow.org/hub/modules/text has some interesting pretrained models. There are weights for https://arxiv.org/pdf/1802.05365.pdf which is similar to ULMFit.