Cuda runtime

Currently trying to train the language model. It worked fine with batch size of 128 yesterday. Today I am having issues. I tried reducing batch size to 64 and still get this error. Any thoughts?
Thank you for your advice! :pray: :smile:

Try 32. From 64 to 32 helped with my desktop Ubuntu setup.

Thanks for the tip. It worked after a few tries and now it is taking a while to train :smile:
Appreciate your help! :pray: