Language Model Zoo 🦍

Let’s clean up and get ULMFiT working on our languages

Jeremy gave us an excellent opportunity to deliver very tangible results and learn along the way. But It is up to us to get our selves together and produce working models.

I know that ULMFiT is a beast (sometimes), you need tones of memory and it taking a full day of worming your room just to see that the language model isn’t as good as you wanted. I get it, but it is how deep learning usually feels :slight_smile: if it was easy there wouldn’t be any fun in doing this.

But we are so close. Let’s get it done!

How about a multiple self-support groups?

I mean a chat where are ppl that work on the same language model. People that care that your model got perplexity of 60, and they understand if that is good or bad. And can offer you an emoji or an animated gif.

A support group == a thread for each language.

If you are in, vote below to join a language group and start training.
The first person that votes should create a thread and link it to the first post above (you have 3 votes):

  • Bengali
  • Chinese (Simplified)
  • Chinese (Traditional)
  • Danish
  • Esperanto
  • Estonian
  • Finnish
  • French
  • German
  • Hebrew
  • Hindi
  • Italian
  • Indonesian
  • Japanese
  • Korean

0 voters

  • Malay
  • Malayalam
  • ** Medical
  • ** Music (generating music in the style of Mozart & Brahms)
  • Norwegian
  • Polish
  • Portuguese
  • Russian
  • Sanskrit
  • Spanish
  • Swahili
  • Swedish
  • Tamil
  • Telugu
  • Thai
  • ** isiXhosa4

0 voters