Thank you for the link. I will have a good read
Just a side notes from online video lecture:
Learning rate is how fast model is learning that means how fast model is loosing the loss.
That’s why we need to choose learning rate at which point loss rate is high.
(Please correct it if it found wrong)
Mh, it would be so just in ideal conditions.
Let’s say that the learning rate is how big your jumps over loss surface are.