Predicting at scale using imdb_scripts

I’ve built a custom model for a problem I’m solving using the imdb_scripts as the framework. However I’m running into the problem of predicting at scale. Has anyone written out how to do large scale prediction using this framework?