Lesson 3 - Strange results for Planet dataset

tomsthom · January 30, 2018, 11:56am

Hello

I have worked with the planet dataset and I’ve got good results from learn.fit (around 0,93%).
However, when I check the results on validation set with augmentation, using learn.TTA(), I get bad results (0,48%).

Is it a good use of learn.TTA() ? How can the results be so bad on validation set with TTA?

ecdrid · January 30, 2018, 12:57pm

That’s weird…

jeremy · January 30, 2018, 2:53pm

Take a look at preds and see what they look like.

tomsthom · January 30, 2018, 4:48pm

Hello

I have the same problem from the unmodified version on the fast.ai Github (lesson2-image_models)
Here is what I see in preds:

jeremy · January 30, 2018, 6:51pm

Many thanks for replicating this. Looks like something we need to look in to!

dikkebalthazar · January 31, 2018, 1:57pm

Have you tried without np.exp()?