Stochastic gradient Langevin dynamics: can someone explain?

Part 2 2022/23
1

While studying about classifier free guidance, this blogpost was cited Guidance: a cheat code for diffusion models – Sander Dieleman (benanne.github.io).
It mentions something known as Stochastic gradient Langevin dynamics (SGLD) in the context of diffusers. Can someone explain this in simple terms?

Thanks
.

1 Like
2

Stochastic gradient Langevin dynamics (SGLD) is just a fancy term for the basic diffusion sampling.

It’s basically what Jeremy talks about in the first lesson about how if we have the gradient of the data distribution, we can perform gradient ascent to reach a sample from the data distribution.

SGLD is just a very specific formulation with the math done to have theoretical guarantees and such but that’s not that important. The basic concept is exactly the same.

7 Likes