How to choose LR by seeing plot?

From my scheduler, I see the following plot as:

As we can see, chosen LR in this notebook was : 2e-2, but the range where loss was stable before going too high is approximately 1e-2.

Any thoughts on how to choose this?


You’ll want to select the point where loss starts going down quickly but is not yet at the bottom. At 2e-2 loss reduction starts accelerating, making it a good LR when using the standard methods.