Hello! Thank you for reading.
I have a curious question about the default learning rate configuration of fit_one_cycle. I understand that the default max_lr is 0.003, and a value for the bottom bound learning rate will be chosen automatically in this case. Is the learning rate then applied evenly to all layers, or is it weighted according to the layer depth? If not, does this imply that discriminative learning rate is always applied to all FastAI models by default?
Also, is the method of learner.opt a valid way for prying in to peek at the different layer’s learning rate?
Thanks for reading