Adam Vs Cyclical Learning rate


(Rahul) #1

Can anyone tell me the pros and cons of using Adam Vs Cyclical Learning rates? Really interested to know when one can be better than the other.