Why apply weight decay?

Oh I know - I didn’t mean to suggest that you should have watched them already, just wanted you to know they’re there if you want to dig in further!.. Yes, learning DL is a marathon, or perhaps an ultra-marathon.

12 Likes