Deploying Deep learning models to production


(Prasann Pandya) #1

Is there a course/good resource on how to deploy deep learning models (how to serve it to production)?

I know how to create a flask REST API but I don’t know anything about Docker, Kubernetes, Microservices, etc.


#2

#3

Since you know how to use flask and make REST-apis, you could run your flask service in gunicorn for e.g.

You dont have to use Docker.


(Matthew Teschke) #4

We’ve deployed ULMFiT in production using endpoints through Amazon’s SageMaker. It does require that you have some familiarity with Docker to get it set up, so it may not be the easiest option for you.