How do you predict a bunch of things if you have your predictor?

fastai fastai dev
1

I have a serie of things to predict, but Im doing a single for, also I see that each predictions shows the loader taking vertical space and it seem that is using a lot of CPU and little GPU (how I know my predictor is running on GPU and if it is, how to use more GPU).

CPU usage
image

GPU usage
image

I have two questions regarding this:

  1. Because it is sequential, should I just spawn some threads? how you do it?
  2. Instead of a progress bar by prediction, I would love that the loader keep track of all the predictions showing progress over the total batch of predictions.
2 Likes