Cyclic Learning Rate

Part 1 (2019)
1

Hi,

Has some one ever tried the cyclic learning rate or one cycle learning policy for using any kind of regression problem?

Has someone tried cyclic learning for RNN (LSTM and/or GRU based networks) ?

What was your experience?
Thank you

2

@jeremy Do you have any opinion about this? Can we use one cycle learning or cyclic learning rate approach for regression problems? If yes what might be the differences from the classification tasks?

Thank you

3

Look at the IMDB notebook and the Rossmann notebook

4

Hi,
Where are they could you share links?
Thank you

5

Notebooks

  • lesson 3 imdb
  • lesson 4 tabular