And you trust fastai to include it if “it just works” 
2 Likes
He uses a beefy Titan RTX card on his laptop and hence! That definitely helps speed stuff along
Speaking of jargons – what is backpropagation ? forward pass & backward pass together ?
In the fastai library NN example, when using resent18 (or deeper networks) as a model, do we need to set pretrain=True?
This is as close as neural nets from scratch we get in fastai course I think. Where many other courses start here we are after building top level multi classifiers & strong foundation on Ethics.
1 Like
If you are struggling with the questionnaire or check your answers, check out the questionnaire solutions
2 Likes
backpropagation is just another name for the backward pass.
2 Likes
Nope the models from the torchvision model zoo are assumed to be pretrained.
1 Like
By default it is set to true.
cnn_learner(dls, arch, loss_func=None, pretrained=True,
cut=None, splitter=None, y_range=None, config=None,
n_out=None, normalize=True, opt_func='Adam', lr=0.001,
cbs=None, metrics=None, path=None, model_dir='models',
wd=None, wd_bn_bias=False, train_bn=True,
moms=(0.95, 0.85, 0.95))
Here is the link of documentation cnn_learner
1 Like
A friendly and respectful reminder to not worry about jargon too much and keep playing with the code, the trap of looking into these rabbit holes always takes me into reading theory which we’ll eventually learn
5 Likes
Agree. The other course I would say would be from scratch outside of Prof. Fei Fei Li was from Andre Karpathy’s CV course (no ethics focus there, just a lot of stuff from scratch which is awesome). @jeremy and @rachel have done a phenomenal job with the new material here I can see (so excited about the new O’Reilly book coming out).
3 Likes
Shared this in our Beginner Study Session last week … but figured I’d share it again here:
https://pytorch.org/tutorials/beginner/nn_tutorial.html
IMO, the best “how does all this work from scratch to PyTorch” article around! Tremendously valuable in guiding me how to debug, visualize, and build/train models.
4 Likes
anyone got the code snippets to show the params as an image?
1 Like
you can try also with hook and callback I guess.
Here is the snippet of code used:
# Grab the model in variable m
m = learn.model
# Grab the parameters
w, b = m[0].parameters()
#plot the weight parameter
show_image(w[0].view(28,28))
5 Likes
I have found this site incredibly helpful for learning and developing regex. https://regexr.com/
You can see the results of your expression given your input text immediately which I found very helpful for learning. It also has a built in cheatsheet and reference guide.
6 Likes
FASTAI NLP regex https://github.com/fastai/course-nlp/blob/master/4-regex.ipynb
Course videos: https://www.youtube.com/watch?v=cce8ntxP_XI&list=PLtmWHNX-gukKocXQOkQjuVxglSDYWsSh9
5 Likes