Which of the HuggingFace optimizer schedulers are already implemented in fastai?

[sgugger]

It’s easier to change it this way than setting a new partial optim function, that’s why I included it like this.