Is it possible to release CUDA memory in backward pass?

fastai
1

As title. I’m a beginner of fastai and I saw a feature in the README that got me interested:

  • A novel 2-way callback system that can access any part of the data, model, or optimizer and change it at any point during training

Thanks for the help.