I implemented the OpenAI paper “An Empirical Model of Large-Batch Training” for Fastai V2 (repo). This implementation is based on Batch size finder from OpenAI implemented using Fastai although I manage to simulate multiple GPUs as the original authors assume plus a couple of bug fixes. I hope that you find this code useful .
Finally, ¿do you think that this feature should be present in the standard Fastai V2 library? I’m willing to put a PR for that. As @muellerzr points out in his course, I find very useful for tabular data where we can use a huge batch size.