How to pick Discriminitive Learning Rates and use SuggestedLRs

Hi all,
Is there a rule of thumb for picking discriminative learning rates? What would you pick here? From the lessons I remember that for a single learning rate, you could pick the steepest point with a negative slope before the minimum. Is there a similar trick for a range of learning rates?

I also noticed that lr_find() gives SuggestedLRs, is there a canonical way to use these in the next training? How do we translate lr_min and lr_steep to a range of learning rates?

2 Likes