I am doing a project where I will be getting a video stream, running real-time object detection on the stream, and outputting a version with bounding boxes and labels. Now, while I am able to do this on a local machine w/ a GPU, I would like to get this working on a laptop without a GPU, as the end-users for my project will not have GPU-accelerated machines.
Would it be possible to leverage the cloud for my project without adding significant (>3sec) delay or is there another option you all would recommend? I have tried streaming to a video streaming server such as Wowza but there was way too much delay (over 1 minute) making the solution impractical.
I am using a custom-implemented version of YOLOv3 as of now but am be open to changing the model if there is a better option available to get it working using the cloud.
Thanks so much in advance and let me know if anyone has any questions about my project!