How to choose LR by seeing plot?

(Sandeep Singh) #1

From my scheduler, I see the following plot as:

As we can see, chosen LR in this notebook was : 2e-2, but the range where loss was stable before going too high is approximately 1e-2.

Any thoughts on how to choose this?

THanks
Sandeep

0 Likes

#2

You’ll want to select the point where loss starts going down quickly but is not yet at the bottom. At 2e-2 loss reduction starts accelerating, making it a good LR when using the standard Fast.ai methods.

0 Likes