Easy vision model deployment

Hi Guys

As I am waiting for the second part of this course, I have been working on a little system to make it very easy to productionize vision models trained with the fastai library.

The backend is a starlette-python application and corresponding dockerfile, all you need to do is add your export.pkl.

You can find it here: https://github.com/gdoteof/fastai-vision-uvicorn-gunicorn-starlette-docker

In my limited testing, it can easily handle thousands of requests per hour on a cheap VPS from digital ocean. (with a resnet 34 model)

There are two front ends.

You can see a demo hooked up to a “Mickey Mouse, Animal Mouse, Computer Mouse” classifier here: https://gdoteof.github.io/fastai-vision-model-inference--react-gh-pages/