Learning rate finder for RNN

Part 2 & Alumni (2018)
1

I was wondering if the learning rate finder method presented in class can be applied to RNN as well? Thank you so much.

2

Sure!

3 Likes
3

As an additional follow up question - Should we try to tweak the learning rate the ADAM algorithm? I believe most instances of it ship with recommended defaults.

4

We covered that in detail in part 1 and quite a few previous threads in #part1-v2, FYI. tl;dr: yes you should.