I came across this blog post from Sylvain Gugger and Jeremy Howard dated 2018 fast.ai - AdamW and Super-convergence is now the fastest way to train neural nets.
Any tips and tricks since then to train even faster ?
I came across this blog post from Sylvain Gugger and Jeremy Howard dated 2018 fast.ai - AdamW and Super-convergence is now the fastest way to train neural nets.
Any tips and tricks since then to train even faster ?