Surgical Actions/Tasks Detection from Videos Using FastAI

Hi All,

I’m trying to to detect actions/tasks from surgical videos. The normal object detection is straightforward which I used to the draw bounding boxes around surgical instruments but I’ve not much experience of tasks detection. How videos are labelled for tasks/actions detections and other challenges.

Does anyone know about an example tutorial for actions/tasks detection from videos? I prefer if tutorial is using FastAI but any help or guidance will be appreciated.

Many Thanks and
Kind Regards,
Bilal

3 Likes

Great question. I’m facing the same challange here.