Share your work here ✅

cedric · November 6, 2018, 6:33am

Yes, we have much trouble and I would say pain, getting the model converted to ONNX binary protobuf file which contains both the network structure and parameters of the model we exported. We are able to go from:

fast.ai + PyTorch ONNX Caffe2 Android devices.

The SqueezeNet model in plain PyTorch from torchvision runs fine on Android devices. Exporting fast.ai ResNet-family of models (we have tested ResNet18, a smaller model with lesser parameters and reasonable GFLOPS on mobile ARM processor/GPU(DSP)) through the ONNX exporter with Caffe2 backend proceed successfully (no error). However, when we put the 2 pb files on the Android app, it runs and crashed on Android devices. Our initial investigation found the crash could be due to discrepancies all over the ONNX specifications and around the tooling that follows ONNX.

The bottleneck is in this step: “Export the model to run on mobile devices”, where ONNX-Caffe2 backend rewrite ONNX graph to Caffe2 NetDef.

Currently, in our project, we are mostly doing detective work on the ONNX and Caffe2 sides. In this project, we learned and discovered a big revelation on how “production-readiness of PyTorch” after the PyTorch 1.0 release announcement, about 2 months ago. We are trying to demystify that announcement.

Please bear with us. Our response might be delay as we are super busy now:

to get the iOS part done
make it easier and more pleasant to ship and test your neural network model in PyTorch on mobile devices
ironing out all the kinks that slow down the shipping process

peter_sensei · November 6, 2018, 7:59am

Supercovergence refers to a consequence of the one cycle policy: as the policy involves partly training with a high learning rate, a regularisation effect (overfitting prevention) and shorter training time with stable prediction performance are achieved.

More in-depth explanation by @sgugger: https://sgugger.github.io/the-1cycle-policy.html#the-1cycle-policy
and the original paper:
https://arxiv.org/abs/1708.07120

nissan · November 6, 2018, 8:45am

Actually Docker on Windows 10 can run Linux container images as well.

aisantoshkumar · November 6, 2018, 10:10am

Just made a classifier which can recognize the language from the script.

I have chosen 4 Indian languages. ( Bengali, Gujarati, Hindi and Telugu )

Architecture: ResNet 34
Accuracy: 95 %

The model was trained on electronic scripts. The test images were having newspaper, posters, textbooks etc. i.e. the test images distribution was much larger than training.

Even then the classifier worked with a very good accuracy.

jerbly · November 6, 2018, 11:13am

I’ve used a model trained on the KDEF dataset to analyze Jeremy’s facial expressions in the lesson videos: https://gist.github.com/jerbly/695df9598eeb64788cb16075cf8a3d4a

oguiza · November 6, 2018, 11:25am

Time series classification: General Transfer Learning with Convolutional Neural Networks

I have performed some time series classification (TSC) experiments applying the standard transfer learning approach we have learned in this course with the idea that it wouldn’t be very useful when applied to time series.

However, the results are great: 93.3% accuracy (very close to the state of the art which is 96.7%).

I think this demonstrates that the fastai transfer learning approach is pretty powerful, and may be applied to lots of different domains, beyond the type of images included in Imagenet.

The goal of the experiment is to identify the country of origin of 30 samples of olive oil based on spectrographs (univariate time series).

The experiment combines 2 approaches that have not been widely used in the TSC domain yet:

Time series encoding as images. I have tested several approaches, and the one that works better is one where time series are mapped to an image by means of a polar coordinate transformation called the Gramian Angular Field (GAF). This creates a rich graphical representation of a univariate time series. If you are interested you can read this paper (Encoding Time Series as Images for Visual Inspection and Classification Using Tiled Convolutional Neural Networks). Based on this the univariate time series on the left is transformed into the image on the right.

Transfer learning with resnet 50. This is a difficult test as the model has not been previously trained on time series images.

I have used a small UCR time series dataset (Olive oil, with 30 train and 30 test samples) to confirm really test transfer learning.

No transformations have been used.

If you are interested, I have created a gist.

I now plan to apply this same approach to other difficult time series classification problems to get more insight into this technique. Also to modify the standard approach using some transformations which might be useful.

Feedback on the experiment is very welcome.

Edit: if you are interested in time series applications, I encourage you to participate in the Time series/ sequential data study group thread where you’ll be able to share your experience, ask questions, etc.

swagman · November 6, 2018, 12:15pm

State of the Art Bangla Handwritten alphabet+character classifier for 84 claases at 94.6% accuracy
I never thought it would be this easy to beat the state of the art classifier of handwritten bangla characters (the paper had 80 characters, I have 84 characters) sampled from 7-24 aged male and female population from all over Bangladesh. The research paper stated this result:

They used a 3 layer vanilla CNN for this, but I am really surprised how proper choice of model : Resnet-50, and optimizer + scheduler : AdamW (??) + 1cycle ; can give a state of the art model in few simple steps — fine-tune, unfreeze, find learning rate, train and predict.

I am just blown away. I though have to disclose that initially it was intimidating on why my model was underfitting; but repeated rewatch of the videos and rereads of the course notes did actually gave back this sweet result! And the best part I made all this in Colab, for free, without shelling a dime.

Here are some top_losses:

I’ll upload the notebook soon, it’s really really messy (and Jeremy said his notebook cells are not in order, I wish he saw mine), and I’ll write a blog-post on how I ended up to this result.

A big shoutout @suvash whose results inspired me to try my own.

maryam · November 6, 2018, 12:31pm

I tried to build a cake classifier with 4 classes: cheesecake’, ‘chocolate’, ‘rainbow’ and ‘redvelvet’ with 1000 images. Here are some top losses after first cleaning up the data.

And here are the error rate and confusion matrix. I doubt if the change of error rate that it increased and decreased again is the sign of overfitting ?
errorAfterCleaning
confusion%20matrix

MagnIeeT · November 6, 2018, 12:38pm

Can you share your notebook. I also created the same classifier for languages.

aisantoshkumar · November 6, 2018, 1:16pm

Hi Jerbly,

how you got ground truth labels?

aisantoshkumar · November 6, 2018, 1:20pm

Hi Neeraj,

Just saw your post. It seems we trained same classifier. I used ResNet 34.

I shall be providing github link shortly

jerbly · November 6, 2018, 1:48pm

Perhaps my titles in the plots are confusing. It’s class / winner / timecode:
class - the class I’m searching for the max probability in the entire video
winner - for that frame the actual class that was maximum
timecode - the time-code for that frame in the video

So in the example below from lesson2 the fourth picture had the highest sad probability but in fact neutral was argmax on that row.

sparalic · November 6, 2018, 2:41pm

@cedric I totally agree, I tried shipping it from onnx to tensorflow or Pytorch. However, it was one nightmare after a next. I was wondering if a pure pytorch implementation with my own custom model is worth the time. Is this the approach you are taking?

rameshsingh · November 6, 2018, 2:52pm

Hi, I used Stanford Cars Dataset (having 196 classes and 8K+ training and validation data points) from Kaggle and built a resnet34 and resnet50 model. I was able to achieve 75% and 87% accuracy respectively.

Deployed resnet50 model using starlette (thanks to @jeremy and @simonw for code snippets and examples). I was able to get the prediction as json output. I know there are many examples available to get beautiful output but I want to use this opportunity to develop skill to deploy and scale the app using starlette/flask and kubeflow.

Here is the gist to the notebook

gist.github.com

https://gist.github.com/rameshsinghds/9e455f64c4339ce6266ebed547e26dc2

CarClassification.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "%load_ext autoreload\n",
    "%autoreload 2\n",

This file has been truncated. show original

In case you have any comment or suggestions please share.

peter_sensei · November 6, 2018, 3:57pm

I got inspired by other course members building a classifier on animals they are fascinated by: I trained my classifier on 9 classes of nudibranch species with around 400 images from Google. Many nudibranches, which are a type of sea slug, show extraordinarily beautiful colours and shapes.

Using a ResNet34 and the typical approach explained by Jeremy my first results are:

Total time: 00:56
epoch train_loss valid_loss error_rate
1 2.456609 1.541697 0.579832 (00:08)
2 1.666967 0.483781 0.134454 (00:09)
3 1.211600 0.336093 0.100840 (00:12)
4 0.933696 0.317061 0.092437 (00:12)
5 0.760397 0.326487 0.092437 (00:12)

Additional unfreezing and learning rate adjustments did not improve the model performance.

It is an awesome way of doing the first steps of your own with the library!

jeremy · November 6, 2018, 4:02pm

That’s great. What paper is that from?

swagman · November 6, 2018, 4:12pm

This one: https://ieeexplore.ieee.org/document/8281853
I used SciHub to access it though. Sorry! I’m penniless.

swagman · November 6, 2018, 4:19pm

I tried it once the problem turned out to be ONNX having no support for Adaptive Average Pooling. Yet the layer is so important.

iyersathya · November 6, 2018, 4:55pm

Hello Devon, I did the same, but I also used bounding box during training to crop the images. Doing so got a better accuracy 93%. Have a look at https://github.com/iyersathya/course-v3

henripal · November 6, 2018, 6:01pm

Working on it