ULMfit implementation in Tensorflow?


(Otto Stegmaier) #1

Has anyone attempted to implement ULMFit in TensorFlow? If so, please share! Otherwise, let me know if anyone’s interested in collaborating on an attempt.


(Samuel) #2

I think the best way to use ULMFiT in Tensorflow is to store the pre-trained model in tensorflow hub.


(Otto Stegmaier) #3

@Samuel - that’s a great option - do you know if anyone has created a TF Hub module for ULMFit?

While that would be great as an option - I was hoping to read through an implementation the model from start to finish for both educational purposes and to train on a different corpus.


(marc) #4

https://www.tensorflow.org/hub/modules/text has some interesting pretrained models. There are weights for https://arxiv.org/pdf/1802.05365.pdf which is similar to ULMFit.


#5

Any updates?


(hari rajeev) #6

Looking for ULMFiT implementation in tensorflow / Keras. Please share details if there are any.


(cindy) #7

Looking for ULMFiT implementation in tensorflow,too! Please share~


(hari rajeev) #8

but ELMO is not same as ULMFiT right ?