Is there a character level Language model pre-trained on Wiki-Text?

(Kiran penumarthi) #1

I am aware that there is a pre-trained word level ULMIT language model available in fastai library.
Is there a corresponding character level language model available which is pre-trained on wiki text??

I am currently working on spell correction using neural machine translation and I am looking for a character level pretrained language model which I can use as an encoder for this.

0 Likes