If it is the statefarm one then the solution is to save the predictions to a bcolz array file after each batch: