Runtime: CUDA out of memory error during inference

You may have stray jupyter sessions, check with:
ps aux | grep jupyter

Also correlate that with the processes usign your GPU memory

3 Likes