The IS a difference between running fit_one_cycle(5, lr) a second time to running once fit_one_cycle(10, lr)
In my cases running fit_one_cycle(10, lr) once helped more. And there is a way to continue the same one_cycle (when for ex you have to reboot your PC or want train for several nights in a row) described here (you just set in cyc_len number of cycles in the current session, start_epoch is from which epoch you restart and tot_epochs is a total number of epochs you want to train across all the sessions).
I’ve tried it and it worked very good for me (except some visual bugs)
3 Likes