ULMfit implementation in Tensorflow?

ostegm · July 11, 2018, 2:06am

Has anyone attempted to implement ULMFit in TensorFlow? If so, please share! Otherwise, let me know if anyone’s interested in collaborating on an attempt.

Samuel · July 11, 2018, 2:20pm

I think the best way to use ULMFiT in Tensorflow is to store the pre-trained model in tensorflow hub.

ostegm · July 11, 2018, 6:44pm

@Samuel - that’s a great option - do you know if anyone has created a TF Hub module for ULMFit?

While that would be great as an option - I was hoping to read through an implementation the model from start to finish for both educational purposes and to train on a different corpus.

marcemile · July 16, 2018, 9:58am

https://www.tensorflow.org/hub/modules/text has some interesting pretrained models. There are weights for https://arxiv.org/pdf/1802.05365.pdf which is similar to ULMFit.

CrazyTensor · August 20, 2018, 3:23am

Any updates?

harikrishnanrajeev · September 13, 2018, 10:06am

Looking for ULMFiT implementation in tensorflow / Keras. Please share details if there are any.

cindy.ll · September 17, 2018, 9:02am

Looking for ULMFiT implementation in tensorflow,too! Please share~

harikrishnanrajeev · September 17, 2018, 2:53pm

but ELMO is not same as ULMFiT right ?

Andreas_Daiminger · March 13, 2019, 4:28pm

Hi @ostegm!
Are you still interested in implementing ULMFit in TF/Keras. I would definitely want to collaborate.