Beginner: Basics of fastai, PyTorch, numpy, etc ✅

[mike.moloch (github:aeamaea)]

@suvash

WALL OF TEXT ALERT

Actually, I really appreciate you taking the time to answer this in detail (as usual) , so I welcome this (and I’m sure a lot of other beginner types like me would appreciate your answer)

I am more comfortable with linux commandline tools so rg/ag would be great to play with. I use grep extensively for my day to day work anyway.

I think I’ll use either a tutorial or a chapter notebook as the starting point and dig through code that way instead of starting with 00_torch_core.ipynb and going down the list because that might just be way over my head.

Thanks!

[jeremy (Jeremy Howard)]

I’d recommend finishing reading the book before diving too far into the library code, because in the book you’ll recreate many of the key classes in fastai from scratch.

Once you’ve done that the fastai code will make much more sense since you’ll know what each bit is doing.

[dhoa (Dien-Hoa)]

It’s great @suvash! I add just one technique that I found super useful for experimenting, Installing an editable version of a library with pip install -e then add the auto-reload in notebook with %load_ext autoreload %autoreload 2. With this you are free to add your code in the library, or add break point, …

[suvash (Suvash Thapaliya)]

@dhoa

Installing an editable version of a library with pip install -e then add the auto-reload in notebook with %load_ext autoreload %autoreload 2.

That’s also a very good idea , esp. if you’re planning to develop on the package. But also, like you mentioned, do print debugging and add breakpoints.

[knesgood (Kyle Nesgood)]

I have a question about untar_data. The documentation comment makes it sound like I can specify a path via fname, but I don’t see anything in the code for it that takes in a path variable. How do I change the destination path? Looking at the code from lesson 1.

[mike.moloch (github:aeamaea)]

@knesgood

The documentation comment makes it sound like I can specify a path via fname, but I don’t see anything in the code for it that takes in a path variable.

Yeah, this was discussed briefly in another thread, but I’m not sure what the answer is to this.

Lesson 2 official topic

Question: How to specify a destination folder when calling untar_data()? This is the function signature: untar_data(url, archive=None, data=None, c_key='data', force_download=False) The documentation states: "Download url to fname if dest doesn’t exist, and extract to folder dest" However, the documentation & the function signature are not matching. Where do we specify dest?

[Mattr (Matt Rosinski)]

When working through chapter 4 from the book I got to the part of visualising the 3 using pandas and thought I would try to test the same approach with an image I downloaded directly from the internet. A URL link didn’t directly work so I googled how to do that and followed instructions on stackoverflow:

import requests
from io import BytesIO
cat_url = 'https://toppng.com/uploads/preview/cat-11525956124t37pf0dhfz.png'
response = requests.get(cat_url)
img = Image.open(BytesIO(response.content))

This allowed me to visualise the imported image but the next step failed

cat_t = tensor(img)
df2 = pd.DataFrame(cat_t[4:40, 4:40])

Likely because the tensors have different dimensions and I had wondered slightly off script to check that I know what actually going on.

And I had no idea what to do next so I thought I’d better search for some help on fastai functions:
Which brought me to your post!!

When running Google Colab and Kaggle with doc(get_image_files) I get the not overly helpful response:

And when trying to pip install nbdev I get the following type of error. Should I be trying to install nbdev on Google Colab or Kaggle? It would be nice to have the link to source directly available so maybe there is a way to have the links displayed?

Sorry for the long post but being able to link to the docs directly from colab would really help if it is possible?

[Mattr (Matt Rosinski)]

I’ve found one solution to my problem. Use Paperspace and the links work out of the box. So much easier to stay in the flow of fastai rather than googling help and becoming derailed…

[jeremy (Jeremy Howard)]

@Mattr

Use Paperspace and the links work out of the box.

Yes this is another reason this is my preferred platform.

You can also just leave a tab open with docs.fast.ai in it, and use the search functionality on that site to find what you’re looking for. One benefit of that is that it’ll show you tutorials as well as the main API docs.

[suvash (Suvash Thapaliya)]

@Mattr

This allowed me to visualise the imported image but the next step failed

cat_t = tensor(img)
df2 = pd.DataFrame(cat_t[4:40, 4:40])

Likely because the tensors have different dimensions and I had wondered slightly off script to check that I know what actually going on.

And I had no idea what to do next so I thought I’d better search for some help on fastai functions:
Which brought me to your post!!

As the paperspace stuff is already covered in the conversation above, I can try to hint you a bit in the direction of how to reason about fixing the error that you ran into.

If I understand correctly, the code failed at the pandas dataframe creation step (defining df2).

• First thing to notice is that the cat_t has a shape of [859, 840, 4], as opposed to the mnist example with [28, 28]
• I’m assuming this is a PNG image of dimension 859px by 840px with 4 channels (Red, Green, Blue, Alpha), hence the total 4 channels.
• The MNIST example is 28px by 28x px with just 1 channel, that’s why it only has 2 axes instead of 3 as in your image.
• When you take a slice of the cat_t tensor in cat_t[4:40, 4:40], you should get a tensor of shape [36, 36, 4] back, as you’re only slicing on the 0th & 1st axis.
• A pandas dataframe holds tabular data, in other words it’s a 2 dimensional matrix/table like data, which means in our case that it can only be created out of a rank-2 tensor (no. of axes = 2, length of shape = 2)
• The cat_t[4:40, 4:40] is a rank 3 tensor. To verify this, try cat_t[4:40, 4:40].ndim or len(cat_t[4:40, 4:40].shape)
• What we can do is to filter out using only 1 channel from this image, so the slice can be fed into the pandas dataframe.
• I’d suggest picking any on channel when building the slice, after which you can check the rank (has to be a rank 2 tensor) and feed to the pandas df creation. (eg cat_t[4:40, 4:40, 0].ndim )

Let me know how it goes. I’ll not post the exact code, but the solution is in the text above. I hope this points you in the direction of resolving the error that you ran into.

[Mattr (Matt Rosinski)]

Thank you Suvash! You have a new admirer

I went from from this image:

To this:

And along the way learnt how to use Paperspace, simulate date, filter out one channel in an image of the simulated data, check ranks of tensors and upload image files to a notebook. Now I would like to control the output size but feel satisfied with my few learnings this last week.

[suvash (Suvash Thapaliya)]

@Mattr

And along the way learnt how to use Paperspace, simulate date, filter out one channel in an image of the simulated data, check ranks of tensors and upload image files to a notebook.

Yay !

[cullenaryArtist]

edit: solved by completely shutting down instance and re running all cells

Hello everyone,
My goal is to clone the fast.ai repo into an AWS instance (conda_python3). I have the instance set up and the repo cloned.

In order to have some things defined I had to add:

conda install -c fastchan fastai
import fastai
pip install fastai --upgrade
pip install nbdev

Something else I tried that failed was:

pip install -e "fastai[dev]"

But received:

ERROR: fastai[dev] is not a valid editable requirement. It should either be a path to a local project or a VCS URL (beginning with bzr+http, bzr+https, bzr+ssh, bzr+sftp, bzr+ftp, bzr+lp, bzr+file, git+http, git+https, git+ssh, git+git, git+file, hg+file, hg+http, hg+https, hg+ssh, hg+static-http, svn+ssh, svn+http, svn+https, svn+svn, svn+file).
Note: you may need to restart the kernel to use updated packages.

I had to remove “.all” from

from fastai.vision.all import *
from nbdev.showdoc import *

set_seed(2)

However, when I try to run the cells I receive:

NameError: name 'set_seed' is not defined

Any advice is greatly appreciated. I also tried restarting the kernel

[manojmohan]

pip install -e “fastai[dev]”

— The above installation command to be used when doing a git clone of fastai repository and then doing a pip install like so:

git clone GitHub - fastai/fastai: The fastai deep learning library
pip install -e “fastai[dev]”

Regarding this problem, ‘I had to remove “.all”’. I suspect your installation is an older version of fastai. Please check the installed version by running,

pip show fastai

It should be 2.7.7. If it is not then please run

pip install --upgrade fastai

[cullenaryArtist]

Thank you! I tried:

!git clone https://github.com/fastai/fastai
!pip install -e “fastai[dev]”

Which successfully cloned a folder. But whenever I try to use

pip install -e “fastai[dev]”

I received:

I was able to move forward without this but I would like to learn best practices and I am worried it will cause a headache later.

[jeremy (Jeremy Howard)]

@cullenaryArtist

Which successfully cloned a folder. But whenever I try to use

pip install -e “fastai[dev]”

You’re missing the ! at the start of that command.

[michael-pru]

Is there a structured ‘SUPER beginner guide’ for dummies like me?

I’m at lesson 2, but already drown in complexity

1. can’t set up pytorch to use GPU on my local machine - using pip/conda - killed many hours for this
2. can’t verify mobile at kaggle (support doesn’t respond), so can’t follow the book there
3. paperspace, despite providing a GPU, runs twice slower than CPU on my local machine
4. using google collab. But what is fastBOOK? I thought the lib is fastAI?? Why does fastbook tries to access my gdrive? and then later fastSETUP??? fastCHAN???
5. why do I need to register at Azure to search for images? Switched to _ddg - now the function call never finishes (42minutes and counting)
6. what’s the difference between PILImage and Image.open()?
7. what is nbdev?
8. then it got weirder - and much more complex - HuggingFace, which evolved into WSL, boilerplate app.py without any understanding, fastsetup/mamba/fastchan/nbdev, and of course the detour into html and JavaScript

besides all that, I’m totally overwhelmed by Jupiter extensions, lots of libraries installation - which I have no idea about, lots of new functions from the library that haven’t got into context yet
RED BUTTON

sorry for venting, I’m just overwhelmed and super frustrated

[Mattr (Matt Rosinski)]

Hi @michael-pru - I hear your frustration and it can be overwhelming at times. I highly recommend you go to the Live coding sessions starting from number 1. It starts off with the basics and the idea was that it would be a step-by-step guide for absolute fastai beginners like you and me (3 months ago). It does diverge from this original intent and goes off on a few deep tangents but should help you get started.

Don’t do both Google Colab and Paperspace. Pick one and I recommend Paperspace because the Live Coding sessions use this.

I really hope the live coding sessions restart at some time in the future because I made the most progress in the shortest space of time by following along. Word of warning. These sessions aren’t a structured course and highly dependent on the questions from people who attended.

Also the setup and recommended first steps changed deep into the sessions because things were still being optimised. If you want to jump to Session 17 to setup up more automatically this session will help you do that. Going from Session 1, however, you’ll set up Paperspace from scratch which is also really helpful. I recommend the going from Session 1 and learning the easy way later but you can choose your path.

Live coding 1

This topic is for discussion of the first live coding session. ｜ session 2 >>> Recording Links from the walk-thru MambaForge installer fastsetup What was covered How to setup and use a terminal/shell What is a terminal? What is a shell? Why use them? What’s a shell script? How to make and run one Installing python the right way, and ensuring that there’s nothing in your system python messing things up Using mamba/conda to install python libraries Installing PyTorch (with GPU support if…

[michael-pru]

Thanks! That’s what I was looking for.
Also decided to switch from Win to Linux - which made everything easier.
Managed to make CUDA available, learned what fastsetup is, starting to get the hang of environments, package managers, jupyter notebooks.
Very helpful series