Unfreeze the model, run some more epochs, then report back.
As the model is frozen, the GPU is not leveraged properly, no matter how powerful it is.
I can add I get more or less the same timings, on a frozen model, with 1070, 1080ti, and a Tesla V100.