After doing deep learning for a few years I’m starting to hit a wall where I’m blocked by my lack of math knowledge.
When I started on this adventure I did a few super quick calculus & linear algebra tutorials, which have mosssstly carried me through DNNs, CNNs, RNNs etc etc, but I dug my heels in and refused to do a full semester’s MOOC on any particular topic.
Now I’m mostly interested in GANs, VAEs etc etc, and I find more often than not I’m way out of my depth, especially on the probability / information theory side of things, and especially when the models get more complicated than toy examples. NIPS was super fun but I wish I’d have been able to get more out of it, without my eyes glazing over whenever I saw a long equation.
2018 has to be the year I get over this hurdle - I can’t put it off any longer.
Wondering if y’all could detail your ‘learning math as an adult’ journey — specific books, MOOCs etc (that you actually did, not just things that have been recommended to you).
Interested in efficiency as ever!