I’m open to ideas. One option is to improve what we completed this weekend: better and faster style transfer, better segmentation techniques (ResNext, Markov random fields), incorporate ideas from recent papers, add WGAN on top, etc.
Another idea is to take the semantic style transfer idea and combine it with speech recognition to build a “hands free photo editing tool” where users can upload a photo and then issue voice commands like “crop cat, blur cat, copy and paste cat, apply fire style to mountains, etc”
I’m also curious to see how realistic of a movie we can create with this. Could we film a person walking and use style transfer to make them look like a character from Avatar?
The organizers of this upcoming event requested slides/demo of our idea. It’s not required, but it’s fair game to work on an existing idea.
Sounds like the start of a great product for movie studios I imagine that the same techniques can be applied to help doctors give voice commands to focus on potential trouble spots in medical images.
@thunderingtyphoons@davecg I don’t think being on the east coast is a handicap that is totally debilitating… If we book a room, we can easily have a skype running at the same time, or just use private chat on the forums.
What time were you guys planning to meet (PST) and what’s the focus. I’m super interested in style transfer and segmentation right now and would love to participate if time permits.
Photorealistic style is the one that interests me too. I’m going to focus on the photorealism component of the loss function to start and see if I can’t figure out how to port it to Keras.
I’m also going to dive back into the Wasserstein GAN paper implementations and see if I can get (or ideally find) earthmovers distance working in Tensorflow. I feel like the insights there are actually a lot broader than just for GANs and it has a lot of applicability to a project i’m working on.
I’ve seen a few papers that use histogram difference minimizations to try to improve the style transfer and I’m curious to see if they’re improved by using earthmovers.