I have gone through a relatively bad case of flu and after nearly 2 wks of not being able to do much I am now getting back into the swing of things
This comes from Jeremy’s Twitter feed from a couple of days ago:
Such a good read! Not only does the fastai library give us the tools to (nearly) trivially implement this, but more importantly I found the discussion really illuminating.
I am not sure what Jeremy has in store for us for part 2 (might be we will touch on this at some point), but reading this paper has definitely broadened my understanding! It also references some other papers like the one on Shake-Shake regularization and wider resnets which turned out to be very approachable and very interesting. Now the only challenge will be to actually find time to play with all this
BTW I feel there are a lot of blog posts hiding in this material if anyone would be willing to give it a go.