not sure if you’re still interested but i’m actually playing with the lesson 7 super-res gan notebook for something and i realise now where you’re talking about. i’ve just noticed that right at the bottom, after training the gan (gen & critic together) for 40 epochs, he literally just changes the data in the learner for a larger size and trains some more:
lr = 1e-4
I thought this was a no-no with GANs tbh, I thought the input/output size was set from the beginning. I assume this is the transfer learning trick you use to “start again” with a pre-trained network which is pre-trained on your own data, not just image-net.
I can’t remember tbh, it’s been a while since I watched lesson 7. If that’s what it is then I’ve just been a dumb-ass and trained all the way though on 256 images. I could have started smaller to speed things up at the beginning and bumped up the sizes towards the end.