I managed to deploy my first model, using Docker and Heroku’s free tier, but I’m wondering if there are any other free-tier options for Docker containers that might be better (including 1-year free tiers).
Heroku is great as a showcase, and it provides 1000 free hours which is more than enough for my one simple app, but it does take around 60-70 seconds to warm up if my app has been idle for more than 15 minutes. I can live with that, but I wonder if there are alternatives.
[The reason I started a new topic is that the previous relevant topic was crammed with hundreds of messages about Zeit Now, which seems to be no longer available.]
I’m going down the same rabbit hole as you.
I found that the Zeit Now “loop hole” has been closed, which means we can’t deploy large models for free, it would seem
I got this email from them:
Deployment failed with the following error:
You tried to create a Now 1.0 deployment. Please use Now 2.0 instead: https://zeit.co/upgrade
I’ve tried to deploy to Heroku, but the deploy is failing with “slug size too large” error.
Since the Resnet50 model is about 300mb itself, I can see why the slug would get large, but mine is around 1Gb.
How big is yours?
I’m now going to try deploying my container to Kubernetes or something on GCP.
Thanks for getting back.
I’ve just managed to deploy a docker image to Heroku.
I assume the 1Gb was all of the python dependency tree. The model itself was only 300Mb.
Anyway, while deploying the python server directly didn’t work, the container route did!