Training looks good while frozen, unfrozen has chaotic losses

Part 1 (2018) Beginner (2018)
3

Training set has 19456 images and the validation set has 4864 images.