Exposing DL models as api's/microservices

[Even (Even Oldridge)]

There’s a thread, complete with an excellent example github by @alecrubin over here:

Fastai / PyTorch in Production

Hi, I’ve been monitoring this thread as my immediate work is to push my GPU trained Fastai model into production. @alecrubin, Is your model trained in a GPU or CPU environment? If in GPU, did you take any measures for bringing into CPU powered AWS Lambda environment? I am having problems with taking my GPU trained model into CPU environment for inference. Kindly help me out with any solutions possible. Subash

Definitely check it out if you’re interested in the topic.