how to retrieve model having lowest validation loss ?
Hopefully someone can add a more authoritative response. I actually asked the same question on the forums during the Live Course but sorry I can’t find the post. The general answer was “don’t do that” because of similarities to overfitting - some epochs “randomly” better-fit the corners of your validation data without the model having learnt the general rules required to provide good predictions on new data outside its test/validation sets.
Check out this post by @meanpenguin:
Considering your bouncing error_rate, it might be:
- overfitting by training too much on limited data, in which case the data augmentation techniques described in the Lesson Videos may help
- or it may be too high a learning rate might such that you are bouncing out of the minima up the sides of the solution valley shown below, in whch case it may help to using the Learning Rate Finder (
[Edit:] Naive side question for my own learning, why are you using fit_one_cycle() ?
Throughout the Course I only saw Jeremy use fine_tune().
My understanding is that with fit_one_cycle() you get less benefit from “transfer learning”
Here is a related post.