Just letting everyone know that on the issue associated with this on Github a workaround was identified and a pull request has been submitted. The workaround is set the learner epoch to zero right before calling tta. For example
learn.epoch = 0
preds = learn.tta(dl=tst_dl, n=5)
Updates on Github at: Fastai2 Test Time Augmentation