FastAi + Kaggle/External Datasets

Part 1 (2019)
1

Hi I have tried to download external / kaggle daasets to paperspace using untar_data but to no avail would anyone happen to have sample code i could borrow ?

2

Never tried paperspace before. Why don’t you try google colab ? There is an option to switch to GPU too within colab.

3

Ill give collab a go, could you share me a sample code to use there if possible ? Id love to get off on a good start with colab ahahah

4

Here you go.

You can turn on gpu by clicking on runtime -> change runtime type -> GPU

5

hi I meant code which does the downloading of data from an external dataset.

6

For that, you can either download your data to google drive and import into google colab.

Here’s the link for importing data from google drive to colab

The other way is to use curl wget command. You can look for it on google.

Otherwise you can also use kaggle api.
Here is colab notebook for integrating kaggle api

7

For the benefit of other people who may have the issue

here is an example of using colab+kaggle to download data:

!pip install -Uqq fastbook

!pip3 install fastai

import fastbook

from fastbook import *

fastbook.setup_book()

!pip install kaggle

!mkdir .kaggle

from google.colab import files

files.upload()

!ls -lha kaggle.json

!pip install -q kaggle

!mkdir -p ~/.kaggle

!cp kaggle.json ~/.kaggle/

!chmod 600 ~/.kaggle/kaggle.json

!kaggle datasets download -d AlifRahman/chestxraydataset

1 Like