Slow Prediction speed even with GPU

I have a sentiment analysis model built with reference to Lesson 4. Now when I want to test it on a bunch of sentences, it takes about 1-2 seconds per sentence. Is there a way to speed up the predictions speed?

I really need it to work faster than this.
I am participating in a kaggle contest, my model works well but to submit, I have to make predictions for 60000 sentences. My model would take days to do that.

1 Like