If you use nn.DataParallel
then effectively you get double the memory. You should use NVLink to get good performance, of course (which requires a 2080 or better IIRC).
2 Likes
If you use nn.DataParallel
then effectively you get double the memory. You should use NVLink to get good performance, of course (which requires a 2080 or better IIRC).