@jeremy Turns out multi-gpu works perfectly with fastai. All one has to do is model=torch.nn.DataParallel(model) and then pass this model to the Learner object.
The error was because I was passing a list instead of tensors which was causing the error reported.