I am trying to run 01_intro-use-multi-gpu.ipynb CNN example using Multi-GPU
I tried using mpify. Here is the code
I am getting the following error
RuntimeError: Output 0 of SyncBatchNormBackward is a view and is being modified inplace. This view was created inside a custom Function (or because an input was returned as-is) and the autograd logic to handle view+inplace would override the custom backward associated with the custom Function, leading to incorrect gradients. This behavior is forbidden. You can remove this warning by cloning the output of the custom Function.
i can see the 2 gpus allocated memory and then after a few secs this error comes
