To ensure reproducibility when using fastai, you may want to follow the approach outlined in this fastai forum post. It’s arguably one of the hardest things to get right and therefore can be frustrating as heck 
I’ve been using this approach in my work for some time now. Try it out with a small model and small dataset to get things reproducible and take it from there.