Choosing a learning rate when lr_find is flattening out

In the case of what you suggested, I usually find the inflection point and move back a factor of 10. So in your case, it would probably be something like 1e-4.

You could also try and use the Automated Learning Rate Suggester. My guess is that it would suggest something around 1e-4

1 Like