How is Learning rate chosen?

[mrfabulous1]

Hi cereal_bird hope you are having a marvelous day!

I always find looking at two or three explanations helps me understand things easier.
Below are some links that cover learning rate!

Picking optimal learning rates?

Hi all, How do you all approach picking the optimal learning rates to fine-tune your models? I am under the impression I should be picking a range that has the deepest declining slope. In my last few cells, I thought a range of 1e-4, 1e-2 or 1e-3, 1e-1 were of the steepest slopes but my results aren’t as good as 1e-6, 1e-4 (which looks flat in the curve to me). V2_Question_on_LR_Lesson1.ipynb Appreciate any thoughts

Doubt - how to use lr_find plot

I am trying to understand the logic behind choosing learning rates for the given lr_find plot.Apparently choosing the slicing range around 1e-01 (corresponding to the lowest loss) blows the validation loss out of proportions, while slice(1e-06,1e-04) has high losses but works just fine. I was under the notion that we choose the range where the loss is the lowest [fastai2] Now, I do understand that slicing range around 1e-01 is a very high range and the exploding validation losses is something …

Cheers mrfabulous1