Hi! I have read some blog posts stating that CLR is best with SGD. This blog post 1 also stated that Adam and CLR cannot be used simultaneously.
However, is it possible to combine the One Cycle LR scheduler with the Adam optimizer? I tried and it seems to work. I just don’t clearly understand why it works when the blog post said it will not. If someone could shed a light on this matter, it would be deeply appreciated.
Thanks and have a productive 2022 ahead!