Questions about batch normalization

[jeremy (Jeremy Howard)]

@berkmeister

I am not sure how reliable it is, but on this link, a couple of people recommended to use Batchnorm between the linear output and non-linear activation if I understand correctly. Any thoughts?

Well spotted. When I implemented this I did some searching and more recent advice seems to be to put it after the non-linearity, based on some experiments.