I’ve gotten through the first 3 lessons and they are fantastic. However, I’ve been struggling to really understand the “rules of thumb” or “best practices” for the learning rate finder. Particularly in Lesson 3, it was mentioned that it is more “artisinal” than science currently, and how you select the learning rates depends on the context.
Does anyone have some notes on what they deem good rules of thumb for how to select the learning rates, and under what conditions?