I found the experiment to support the manifold hypothesis in section 3.1 very interesting. Unfortunately I do not understand (yet) how to implement the sliced score matching equation (3) to train the auto encoder described in appendix B1. They mention that it uses forward mode auto differentiation, so I guess I need to read up some more until I’m able to reproduce this experiment.