Hey guys,
I wanna know how are you guys currently deploying Pytorch models to production. I know the basic approach of using Flask but anyone using a more scalable approach? Did anyone try writing code for a custom solution that does caching and batching?
Also, if you’re interested in deploying models to production, is it for work or just a hobby?