Paperspace running lesson1-rxt50.ipynb, lesson1-vgg results in out of memory issue

I tried to run the lesson1.rxt50 using resnet50 and noticed that when all the layers are unfrozen the resultant execution causes an out of memory exception has anyone encountered this issue and is there a solution.

lr=np.array([1e-4,1e-3,1e-2]), 3, cycle_len=1)

The last line results in an out of memory.
I have noticed that on paperspace I frequently run into the issue of out of memory. I get the below out of memory error

cuda runtime error (2) : out of memory at /opt/conda/conda-bld/pytorch_1518244421288/work/torch/lib/THC/generic/