Hi everyone!

Since we are going to work on structured data in Part 2 I thought this paper could be interesting: Categorical Reparameterization with Gumbel-Softmax.

I just saw this concept used in a deep learning online seminar and have not applied it myself yet. The idea is to replace samples from categorical variables on which we cannot apply backpropagation by something differentiable. From what I understand, this allows us to work with a differentiable version of our data in the network and recover the categorical values at the end.