Share your work here ✅

(Andrew Chaffin) #71

I pulled data from Kaggle - https://www.kaggle.com/slothkong/10-monkey-species

10 species of monkeys with about 100 training images for each. I didn’t see any need to do the fine tuning section with this data because how do you get better than pretty much perfect right from the start? Amazing. Gonna find some other data and go again.

0 Likes

(Ad Postma) #72

Thanks for your reply Ethan. I will look into that.

1 Like

(Abhi Gupta) #73

Hello everyone, I found this dataset on kaggle using the google dataset search which is for classifying fruit photos. So I tried my hands and got to 0.5% error rate within 4 epochs. I used resnet34 as the architecture.
Here are the images

The only things my model is classifying wrong are same things with different labels. :smile:


1 Like

(Vitaliy Bondarenko) #74

Hi Radek, how do you approach memory problem with fastai for this competition? fastai learner loads all dataset into memory arrays, and this dataset is too huge to do it.

these are some experiments I did for previous fastai version: Experiments on using Redis as DataSet for fast.ai for huge datasets

2 Likes

#75

Hi Vitaliy - for this competition I load the data directly from HDD.

0 Likes

(Sparkle Russell-Puleri) #76

I wanted to represent for the Caribbean programmers. So I built a classifier to classify Trinidad & Tobago Masqueraders versus regular islanders.

Here is a sample of my dataset

Here is a sample of my predictions

Here is my confusion matrix

Pretty decent results for a very small dataset. Notebook will be forthcoming.

3 Likes

(Ilia) #77

I was thinking that data loader accepts paths and loads tensors on demand, no? Otherwise, it would be impossible to deal with any, even relatively small modern dataset. I remember that I had out-of-memory errors even when trained a dogs breeds classifier.

As I know, PyTorch datasets API doesn’t force you to load everything into memory at once. You only need to define how to retrieve a single instance based on its index.

0 Likes

(Vitaliy Bondarenko) #78

How? if you take all 50M images you will likely be out of memory on p2/p3.xlarge instance.

0 Likes

(Vitaliy Bondarenko) #79

I didn’t look into latest fastai, but the fastai from last year loaded all data into ArraysDataset in memory in learner.precomputed call.

0 Likes

#80

I’m not sure where, maybe it was with precompute=True, but in vision, fastai only loads the images a batch at a time when needed for training/validation.

2 Likes

(Neeraj Agrawal) #81

I think in this version of fastai, pre-compute option is removed.

0 Likes

(James Requa) #82

You can also use an s3 bucket to store the data on aws and use a library like boto3 to access the data from the bucket

1 Like

(Michal Wawrzyniuk) #83

Hi,

Small and simple spin off from lesson1
It was one of my last hackhathone task
to do recognition of road signs.
As we can see without big hassle I achieved 98% on very unique data set black and white data three classes
AR-arrow
LD - left diagonal
RD - right diagonal
I loaded data from CSV

Cheers

Michal

0 Likes

(Fadhli Ismail) #84

This is quite a nice project. I love the simplicity of it. Nice work.

2 Likes

(Fadhli Ismail) #85

This is cool. How big is your dataset?

1 Like

(Vitaliy Bondarenko) #86

I am talking about RAM.
Have you succeeded to train 1 cycle with all images?

0 Likes

(Michal Wawrzyniuk) #87
class
AR 485
RD 449
LD 119

Row size variety

image

Column size

image

I did it on fast.ai v2 first time by modifying same lesson dog breeds
and achieved then 95% max

M

0 Likes

(Likhit) #88

Your actual achieved accuracy with v3 in your notebook with resnet50 is 98.05 % ! You forgot to remove learn.load(‘stage-1-50’) at step[31].

2 Likes

(Michal Wawrzyniuk) #89

Correct it was V3 with accuracy 98%. Indeed thanks for noticing it:)

2 Likes

(Neeraj Agrawal) #90

I created a text classifier, which is able to detect language of handwritten document based on images. Dataset contains handwritten text in four languages: Bangla , Kannada, Oriya, Persian.

Here is sample dataset:
image

I used the lesson 1 notebook. With resnet50, accuracy of classification is ~97%.

Here is the prediction top losses:

and this is confusion matrix:

image

I used dataset provided by authors of this paper.

Next step would be to include other Indian languages and improve the classifier.

21 Likes

Share you work here - highlights