Kaggle Comp: NLP Classification

Here’s an active Kaggle competition that could be a good opportunity to use fastai for NLP classification. The challenge is to classify the author of the text.

11 Likes

Anyone willing to team up and participate?

Cool. I have a question about training on a small NLP dataset.

Is there a way to increase dropout after a certain number of epochs?

I find that after training a language model on a different dataset, it overfits after awhile. If I increase dropout in the original architecture before any training, then it doesn’t converge optimally. Loss is still decreasing, so I want to train further, and don’t want to overfit.

Here’s what it looks like,

[ 0.       3.93047  3.74086]                               
...                         
[ 10.        3.50935   3.50461]                            
[ 11.        3.42893   3.45722]                             
[ 12.        3.32166   3.42504]

I sure am! I don’t have experience with NLP, but this should be a great learning experience!

1 Like

Very good idea… Let us analyze text. How do you want to go about?

1 Like

Definitely count me in :innocent:

1 Like

Me too …

1 Like

I would like to participate too.

1 Like

Count me in! :slight_smile:

1 Like

Great! We’ve 6-7 members. How many of us have prior knowledge of NLP?

Hey! I have experience with NLP, can join up if you want. I have primarily used Keras and TF before.

1 Like

count me in as well.

1 Like

Many teammates are joining. Let’s form a team 24 hours from now?

A little bit of experience in NLP.

But really interested to learn more…

1 Like

I am also interested to join a team. But not much prior knowledge of NLP.

1 Like

I am interested too… But not have much experience with NLP…

1 Like

Created group! Pls. check your messages.

1 Like

Too late to play along?

Why dont you guys create a open thread here and discuss. It can help others including me even if we are not participating :slight_smile:

Not at all… You can join too…