ULMFit - Portuguese

(Pedro) #21

As discussed with @piotr.czapla, I’ll open an issue at the fastai github. I’m gathering the information needed for the issue, and will open it once I’m done.

0 Likes

(Piotr Czapla) #22

For a quick fix simply save the best model and restart the training by loading the weights,
to do so use SaveModelCallback https://docs.fast.ai/callbacks.tracker.html

0 Likes

(Pedro) #23

OK, thanks!

0 Likes

(Piotr Czapla) #24

Hi, we are trying to make summary of ulmfit efforts see: Multilingual ULMFiT
Do you have some results trained on the publicly available / official data set?

0 Likes

(Fernando Melo) #25

Hi @piotr.czapla ,
Yes, I can help with that. I have a few details that I’d like to discuss with you. Can I have your e-mail?

0 Likes

(Piotr Czapla) #26

piotr.czapla@gmail.com

0 Likes

(Fernando Melo) #27

Ok. Thanks

0 Likes

(Danilo Ribeiro) #28

Wow, really cool to find you guys around here working with portuguese datasets.

I would love to cooperate! :wink:

0 Likes

(joao.br) #29

Hey guys!

Whats the status on this? Do we have a portuguese model already? if not, how can i help?

@piotr.czapla do you know how do i start to contribute to this? any place i can start?

Thanks and congrats for the efforts!

0 Likes

(Piotr Czapla) #30

Hi Joao We do have a model but I suspect that it isn’t that performant as it could be as it was trained on wikipedia that has formal language. You could try to train a model that is using informal language like one used on reddit or twitter. We had good results on Polish language by pretraining on different text types. We could then test that model on some dataset and compare it to one pretrained on wikipedia.

0 Likes