Deploy model to Production

Hey guys,

I wanna know how are you guys currently deploying Pytorch models to production. I know the basic approach of using Flask but anyone using a more scalable approach? Did anyone try writing code for a custom solution that does caching and batching?

Also, if you’re interested in deploying models to production, is it for work or just a hobby?

1 Like