Refer this piece for PyTorch. 06. PyTorch Transfer Learning - Zero to Mastery Learn PyTorch for Deep Learning
For fastai, this thread can be a good starting point - Understanding gradual unfreezing of model - #5 by AmorfEvo. Refer to the chapter of the book mentioned in the thread for more details