How can you train your model on large batches when your GPU can’t hold more than a few samples?

found a solution.

Thanks to lafoss