Reproducing "How to train your ResNet" using fastai

[gkk (Grzegorz Kossakowski)]

Have you looked at GPU utilization? Is it low? See my comment here:

DataLoader performance for categorical data

It’s tangled with some work code but I can see what I can do. Are you sure you have the same problem? The easy way to check is is compare CPU and GPU utilization (using htop and nvtop for example) while training. If you see low GPU utilization (for me it was below 10%) and high CPU utilization then you’re onto something. How many examples do you have in your training set?

If you see GPU utilization being low and CPU utilization being high, it’s easier to believe the training is CPU-bound.