TabularData - Mixup

[abhikjha (Abhik)]

Hey Zach

So nice to see your prompt reply.

I am referring @sgugger 's reply here:

Mixup data augmentation

It has proved very powerful as a regularization technique (which also means you can reduce dropout, weight decay…) Yes, I’ve tried it in NLP, mixing the outputs of the embedding layers and it has given good results. Hoping to have time to experiment with this more and write a paper about it when the development of fastai_v1 slows down a bit I think it would also be helpful in tabular data (again mixing the embeddings fro categorical variables), not sure about object detection since I d…