TorchServe to serve fastai models?

[bbd]

Today AWS and FB launched a model server for pytorch:

AWS and Facebook launch an open-source model server for PyTorch – TechCrunch

pytorch/serve

Anyone tried to use this framework to serve fastai2 models?

[sunbc0210]

Yes.

Share your V2 projects here

We recently managed to deploy a FastAI trained PyTorch model in TorchServe. In case anyone runs into a similar situation and looking for a recipe: Let me know if you found it useful.