Select correct image from rough sketch

I had an idea for a project which would be an application that would select the correct image from a library using a rough sketch as the input.

I’m not sure what the correct approach would be, feature detection doesn’t seem quite right, I was wondering if anyone had any ideas?