Deep Learning Brasília - Lição 5

[pierreguillou]

OHE * weight matrix == embedding

From @jeremy (link to post) :

It’s not a conceptual comparison, it’s a literal identity. They are actually the exact same thing: OHE * weight matrix == embedding. Try a small example in a spreadsheet or on paper and I think it’ll be clear. If so - tell us what you learn! If not - please ask some more!