Another treat! Early access to Intro To Machine Learning videos

(Aditya) #270

Found this PDF…

(Jeremy Howard) #271

That depends entirely on the problem and data. There’s no “right answer” here. Do you think the time period, or the start date, is the important choice for this model?


I can’t fail to notice that the lectures stopped coming! :slight_smile:

Still, the ones that were published were very, very educational! Thank you! Just what I needed on Random Forests :slight_smile:

BTW gearing up to do the linalg course :slight_smile: Ah the good things from @fastai just keep on coming! :smiley:

(kind of hard to believe a person / group of people can be so generous with others from half across the globe these days without any strings attached - definitely a very inspiring role model)

(Aditya) #273

Expecting one today lately…

it’s been a week since Jeremy’s last post…

(Sanyam Bhutani) #274

Be great but be Grateful :smiley:
Definitely the best course and community that ever happened to my student life and online courses-side life!


Yes, this is pretty much what I wanted to say :slight_smile: Even if those are all the lectures that we get, that has been already beyond amazing :slight_smile:

So much great material to work through! :slight_smile:

(Jeremy Howard) #276

Just added the lesson 9 video

(Jeremy Howard) #277

There wasn’t one last Thursday due to the Thanksgiving holding in the US.

(Jeremy Howard) #278

Just added the lesson 10 video.

(Jeremy Howard) #279

Just posted another new ML lesson (we did an extra one this week after missing one with Thanksgiving last week).

(Tim Lee) #281

Hi all,

I’m lucky enough to be in the MSAN program. To help you navigate the videos, i’ve attached my outline of the topics. Let me know if the video to topic list is out of sync.


  • Tim

Lecture 1

Introductions and class basics

Lecture 2

Python basics
Git, Symlink, AWS
Python notebook basics
Crash course on pandas
FastAI introduction
Feather Format
Run your first Random Forest

Lecture 3

R^2 accuracy
How to make validation sets
Test vs. Validation Set
Diving into RandomForests
Examination of One tree
What is 'bagging’
What is OOB Out-of-Box score
RF Hyperparameter 1: Trees
RF Hyperparameter 2: max Samples per leaf
RF Hyperparameter 3: max features

Lecture 4

Forecasting: Grocery Kaggle discussion, Parallel to Rossman stores
Random Forests: Confidence based tree variance
Random Forests: Feature Importance Intro
Random Forests: Decoupled Shuffling

Lecture 5

Summary of Random Forests
Data needs to be numeric
Categories go to numbers
Subsampling in different trees
Tree size
Records per node
Information Gain (improvement)
Repeat process for different subsetes
Each tree should be better
Trees should not be correlated
Min Leaf Samples
Max Features
interpretting OOB vs. Training vs. Test score
Feature Importance Deep dive
One hot encoding
Redundant features
Partial Dependence

Lecture 6

What makes a good validation set?
What makes a good test set?
Random Forest from scratch : setup framework

Lecture 7

Motivations for data science
Thinking about the business implications
Tell the story
Review of Confidence in Tree Prediction Variance, Feature importance, Partial Dependence

Lecture 8

Building a Decision Tree from scratch
Optimizing and comparing to SKlearn
How to do 2 levels of decision trees
Fleshing out the RF predict function
Assembling our own decision tree

Lecture 9

Deep Learning
Using pytorch and a 1-level NN
Walkthrough of MNIST number sets
Binary Loss func
Making a LogReg equivalent NN pytorch

Lecture 10

Rewriting the 1-layer NN from scratch
Rewrite LinearLayer
Rewrite Softmax
Understanding numpy and torch matrix operations
Understanding Broadcasting rules
Rewriting matrix mult from scratch
Start looking at the fit function

Lecture 11

Rewriting fit from scratch
Digression of Momentum
Rewriting gradient and step within fit function
Bag of words / CountVectorizer
LogisticRegression w. Sentiment

Lecture 12

NLP : trigrams
Naive Bayes Classifier
Binarized version of NB
NBSVM - combination of probs
Storage efficiency of 1-hot
RossMan store examination
Introduction to embeddings


I am trying ML Lesson 1 RF on a different datset.
To convert into categorical values,I have done:


Now to apply same kind of categorical codes to ‘test’ dataset as Jeremy mentioned in video, I am doing:


But I am receiving below error:

Please help.

(Prince Grover) #283

It’s actually fit(net, md, epochs= 2, opt=opt, metrics=metrics, crit= loss) as I see in fastai/fastai/

(Rikiya Yamashita) #284

Thanks @timlee :slight_smile:

(Jeremy Howard) #285

What are thoughtful and helpful thing to do :slight_smile:

(Tuatini GODARD) #286

Hi guys,
Going back to this timestamp where Jeremy describes how he find a good validation set by plotting the loss of different validation set scores against Kaggle test scores from the public leaderboard. I tried to do this experiment myself on the groceries competition by using the different validation sets Jeremy described in his video but I just feel like there is something wrong with my approach. Here are the results:

I first trained on the splits in the orange columns, saved the results and retrained the model from scratch on the split from the blue column before submitting the results to Kaggle.
As you can see my lines seems to be almost identical even if the validation sets differs. Do you have any clues why it didn’t work? (Or maybe all the validations sets are equally effective? But I doubt so)
Thanks :slight_smile:

(Jeremy Howard) #287

Just posted the final machine learning lesson! :smiley:

(Ramesh Sampath) #288

Thank you so much for sharing with us the ML Videos. Enjoyed every one of them. But the last one on “Ethics” is the best of all. After empowering us with the methods and knowledge, you have given us the moral compass to guide us forward.

Thank you and the best wishes to all the MSAN students who were fortunate enough to take this class in-person.

(Tuatini GODARD) #289

Thanks a lot for all you’ve done Jeremy. I really enjoyed every lessons of this mooc (as well as the one on DL). Knowing the lesson 12 being the last one leave me with a little feeling of emptiness. I’m looking forward for DL & ML part 2. Thanks again :slight_smile:

(rachana) #290

Thanks so much Jeremy!! These lessons are extremely valuable. Thanks again a lot for sharing your indepth knowlege…