fast.ai Course Forums
SGD with warm restarts - should I use momentum?
Deep Learning
maxmatical
(Max Tian)
August 18, 2018, 6:16pm
1
I’m just wondering if it’s a good idea to use (Nesterov) momentum with cosine lr annealing. Thanks