Google BERT on Kaggle Movie Reviews dataset

(Trong Canh) #1

Hello, I am using BERT on the Sentiment Analysis on Movie Reviews dataset from a past (4y ago) Kaggle competition ( The dataset has around 150K training examples and a public test set (for public leaderboard) of 67K examples.

After running 2 epochs (took me 3h) I got 0.688 score on the public leader board which is in the top 5 on the public leaderboard (private leaderboard is not available anymore). It seems to work but I will try to tune the learning rate to see if I can get better result.

I would like to share this in case someone want to do the same experiment so that we can compare the results.


Hi Canh,
Is it possible to share your code?
I am also planning to do the same task.

(Trong Canh) #3

Hi @Skeptic,

Sorry for the late response. I will put my code somewhere so that I can share, but basically what I did is to follow the classification examples in ( :

  • Prepare train.tsv, dev.tsv, and test.tsv files with sentence \tab label format (for test.tsv just put 0 for label)
  • Create a sub-class of DataProcessor object for your task (see some other examples in the file)
  • Finally run the script with the option --task_name to be your defined task.

Hope that helps.


Hi Canh,
Thanks a lot for the reply.