Label smoothing and when to use - new paper by Google

Hinton et al have published a paper titled “When does Label Smoothing help?”. They did some great visualizations and also went deep into how label smoothing calibrates a neural network and when and when not to use it.
Some visuals:


I wrote a summary article with the key take-aways and bit ‘less math, more code’ on Medium:

and link to the full paper is here:

Enjoy!
Less

15 Likes