Unstable learning rate - goes down, up and down again

I’m getting weird results when running lr_find(). Any ideas what could be the cause of that?

image

I believe that if you don’t have edited nothing on your code may be a bug on some package version or in case you do have changed something, I believe that is important to take a look on your code.

But yet if every packages is very tightly controlled with the exact version available on between end year 2017 and early 2018, and you also don’t changed nothing on the code that could create such impact it possibly is correct and you have to pick the value around 10^{-4}

1 Like