GAN level outcomes without GANs

Deep Learning
1

I have recently enjoyed watching Jeremy Howard’s interview in Lex Fridman Artificial Intelligence (AI) Podcast. Totally worth it if you haven’t seen it.

At time 55:15 (youtube link below) in the interview, Jeremy says: “We’ve actually recently shown you don’t need GANs. We have developed GAN level outcomes without needing GANs”

He also mentions these techniques being related to transfer learning and new loss functions.

I’m very interested about this topic and I would appreciate if anyone in the community could point me to papers, code or discussions around this topic.

Thank you for your help,
Pablo

1 Like
3

Check out this youtube video, where Jeremy discusses his success with “Decrappify” techniques. (Minute 3:40)

4

He is talking about the “NoGAN” technique, see https://www.fast.ai/2019/05/03/decrappify/

Rather than starting a generator and critic arms race on day 0, you train a generator on its own, then a critic against generated images, then bring them together for traditional GAN training.

2 Likes
5

This goes into the direction of GAN-like applications with only a single robust classifier NN:

2 Likes
6

Thank you all for your responses. These are great materials, I will read and study the examples more in depth.

1 Like