Found this thread really helpful for SSD: About bounding box localization
I’m trying it out today so I’ll let you know.
I never got Faster RCNN working on a custom data set… but maybe someone more experienced than me can give it a shot. I tried both pytorch and caffe backends. Here is a tensorflow version I haven’t tried yet.