Maybe , I was updated a bit to early and my dataset and dataloader creation for test set was broken with 1.0.24. I will figure out ho to handle it later today.
Something related to this thread https://forums.fast.ai/t/error-when-adding-in-a-test-set-via-add-test/30413