I have been training DNN model in two different configurations. In first configuration, I train whole DNN model. In second configuration, I train only Fully Connected layers of the model. In theory, training only FC layers should take less time as compared to training of whole DNN model for any given number of epochs. However, I am getting almost equal time when I train the model using ‘Learn’ from Fastai v1. Moreover, the parameters are frozen also. I have checked it through summary of ‘learn’.
Screenshot for training of complete DNN model:
Screenshot of training only FC layers: