Lesson 7 - Official topic

[muellerzr (Zachary Mueller)]

@muellerzr

Everything from attention to self normalization to unsupervised pretraining were attempted or discussed

For those interested in exploring said paper, I’ve opened up a thread here:

Deep Learning for Tabular Data: An Exploratory Study - By Jan Andre Marais

I wanted to bring to light a fantastic thesis by Mr. Marais here. It’s 144 pages long and explores fastai's tabular model in a way I’ve never seen done before. Here is a link to it. I wanted to open up this thread as a discussion for it as it’s well deserved in my opinion. I’ll highlight here important parts/chapters worth noting and exploring. Hopefully those of you interested in the tabular field can join in on the conversation! GitHub: https://github.com/jandremarais/tabularLe…