Why is lr_find loss vs learning look so smooth

(kelvin chan) #1

Got a Q about lr_find() as discussed in DL1. The plot of loss vs. the learning rate look very smooth compared to what I have. Is this due to batch_size? I used 32. Anyone know what they used in DL1?

1 Like

(Eraldo Rezende Fernandes) #2

I found this great article by Sylvain Gugger that explain this and more in details.

0 Likes