I wanted to share what we’ve been working on at team 26. We wanted to explore high-performance use cases, so we created a web app to do real-time facial expression recognition.
To maximize performance, on the client side the we track the face with javascript and crop it out so that we only need to send the face across the network. This works well: an average request is only 300 bytes and completes full round trip in under 300ms.
Please check out this demo video from chrome on a mac.
Also, go ahead and give it a try. It requires webrtc but that is available on all modern browsers. Note that if you’re on ios you need to use the safari browser and not an embedded webview since webrtc does not work in webviews.
Full write up, source code, and model weights coming soon!