Note that RAdam and Lookahead have both been added to fastai v2. I didn’t create a Ranger shortcut, but you can use
def opt_func(ps, lr=defaults.lr): return Lookahead(RAdam(ps, lr=lr))
for it (and potentially change any default hyper-param). Lookahead can be wrapped around any fastai optimizer for those wanting to experiment.