Lesson 1 In-Class Discussion


(Dipjyoti Bisharad) #148

In reality it shouldn’t continue improving forever. At particular learning rate, the rate would be so large that the gradient descent would in-fact diverges from minima.


(yinterian) #149

where are running this?


(Anand Saha) #150

If you want to be nerdy, you can actually calculate how much memory your network will occupy in the GPU - by calculating all the weights and biases and gradients etc. (don’t do it, there will be millions and millions of them in a serious network)

Practically - you run your program, if it reports OOM error, reduce batch size. Good thing is, you will get to know if your batch size is big or not in the first epoch itself.


(Kevin Bird) #151

I have a laptop with a gpu built in.


(Aditya) #152

This might help…
We need to move files to the correct directory…


(Devan Govender) #153

Is the learning rate plot created from randomized mini-batches?


(Zao Yang) #154

Is there a link to the new AWS setup? Jeremy mentioned that he’s posting it but not sure if he already posted it.


(Soumya) #155

What is the assignment for this week ? Any updates on setting up AWS ?


(Alessia Marcolini) #156

To install OpenCV through conda:

conda install --channel https://conda.anaconda.org/menpo opencv3


(Sanyam Bhutani) #157

So trial and error, cool.
Preferably in the multiples of 2.


(Vitaly Bushaev) #158

Will this or other lessons have any homeworks other than going through notebooks ?


(Vikrant Behal) #159

Jeremy mentioned things we could do in lecture. I believe homework for this week is getting comfortable in tools we will be using and playing with code.


(Clayton Yochum) #160

Talking Machines! It’s so good it ruined me for other DS podcasts, can’t find any others worth sitting through.


(Daniel Freire) #161

I’ve tried, but it keeps showing a error message:

➜ fast_ai conda install --channel https://conda.anaconda.org/menpo opencv3
Fetching package metadata …
Solving package specifications: .

UnsatisfiableError: The following specifications were found to be in conflict:

  • opencv3 -> python 2.7*
  • python 3.6*
    Use "conda info " to see the dependencies for each package.

(WG) #162

OpenCV can be a challenge to get installed correctly. This tutorial is the most helpful thing I’ve found to get it working in an anaconda environment:


(Jeremy Howard) #163

I suggest just pip install opencv-python - at least that’s what I use.


(Rajat) #164

Regarding Data Augmentation, I was reading https://petewarden.com/2017/10/29/how-do-cnns-deal-with-position-differences/ blog retweeted by @jeremy on Twitter and then I wonder what difference does data augmentation make?


(vikram iyer) #165

I think its pandas_summary. (underscore)

You will also require pytorch, torchvision, opencv in addition to the ones @poppingtonic has mentioned.


(Daniel Freire) #166

It works perfectly! Thanks, Jeremy!


(Alessia Marcolini) #167

The answer lies within this parody song of a friend of mine: