Hi, using lesson3-IMDB notebook as a reference, I am solving the Quora insincere questions challenge on Kaggle. Right now I just want to solve the problem without really worrying about the rules.
As per my understanding, I have done everything right and do get a high accuracy ~96%. However when I use it to do a single prediction from existing training data, it is failing miserably.
In: learn.predict("Why are men selective?") Out: (Category 0, tensor(0), tensor([0.6251, 0.3749]))
The complete notebook can be seen here
I haven’t done any feature engineering yet.
What could be the issue here? Pls share your thoughts/ideas.
As I wrote this perhaps one thing I need to check is the presence of insincere questions in the validation set.
Also, can we use the ClassificationInterpretation for this (text) problem? It works but docs say it should only be used for vision.