Lesson 4 - Official Topic

[ilovescience (Tanishq)]

I think this was the one used in fastai v1:

Speed up batch size discovery hundreds of times (to fit into your GPU RAM)

OK, you know how time consuming the bs discovery is, you got to run lr_find/fit and then if bs is too big do it again, then the next stage, and repeat it all together again and again, then the next stage, and meanwhile waiting, and waiting and waiting… Then recently I discovered that all the required GPU memory is setup during the first batch of the first epoch see tutorial. So I thought why do I waste hours waiting for things to finish. I also find the waiting makes me really tired physically.…