Project Proposal: SeGAN for supervised image segmentation

(Constantin) #1

I’d like to implement this paper:
SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation

They use a (W)GAN architecture for image segmentation. The generator part (called segmentor here) uses a U-Net like architecture, while the discriminator (here called critic) employs a novel multi-scale loss (essentially MAE over feature maps on different scales).
I’d start out with something simple to get the code working (e.g. thresholded MNIST) and then move to more real-world data sets.


(Constantin) #2

In the mean time I went ahead and implemented a SeGAN class including the training loop for the non-Wasserstein case.
I got it working on MNIST and am testing it on production data. Once I am satisfied with it I might post some code.

(Davide Boschetto) #3

Well, well. This sounds VERY interesting! I’m following your work, for sure, if you want to keep us updated!

(Constantin) #4

Well, I got around to create a github repo. Please take a look and let me know what you did with it.
Consider it a work in progress, naturally :slight_smile:


Hi iNLyze, thank you for your code for SegAN! You helped other people who are also interested in SegAN and gave them something to start with, we really appreciate your work. We have released our SegAN code here. Our original SegAN code was written in Tensorflow with a very old version of TF and the released version is reimplemented in Pytorch on a skin dataset with a different architecture (data are very similar to natural images so everyone can try it on his own tasks). The released code might not be perfect for now but I think the idea is there. Feel free to play with it and let me know if you have any questions!

(Constantin) #6

Dear @YuanXue, I appreciate your new version in PyTorch. I feel a bit bad myself about not being able the code I released, as I have been goong through a diffixult stretch in my personal life. Segmentation is still something that excites me. Once things are improving I‘ll be happy to check out your version. I might take mine down then, since I wonder if it will still be needed. Keep up the good work!


No worry, you can keep your code since people are interested in it and you truly helped them with your code. Besides, I’m glad to see other people could provide some different perspectives on SegAN, and please don’t feel bad for yourself since my code is not perfect either. You’ve done very good job, hope you will feel better in your life soon!