What should my learning rate be?


(YJ Park) #22

Thank you for the link. I will have a good read :grinning:


(Mayur) #23

Just a side notes from online video lecture:
Learning rate is how fast model is learning that means how fast model is loosing the loss.
That’s why we need to choose learning rate at which point loss rate is high.
(Please correct it if it found wrong)


(Andrea de Luca) #24

Mh, it would be so just in ideal conditions.
Let’s say that the learning rate is how big your jumps over loss surface are.