Hi all, while trying to troubleshoot a bug I added
print(len(xb))
print(xb[0].shape)
after line 17 in basic_train.py. If one then executes the resnet34 (frozen) training ([In] 13 in the notebook) the output shows that the batch size goes up all the way to 128. You can scroll down to the bottom of the output to see that, but it also happens in the middle. Why is that?
Here is the output:
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([63, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([95, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([63, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([95, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([63, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([95, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([64, 3, 224, 224])
1
torch.Size([63, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([128, 3, 224, 224])
1
torch.Size([95, 3, 224, 224])
Total time: 04:08
epoch train loss valid loss error_rate
1 1.136672 0.301131 0.085828 (01:06)
2 0.491456 0.243652 0.073852 (01:02)
3 0.312260 0.235624 0.073187 (01:00)
4 0.230828 0.213188 0.066534 (00:59)