Freezing batch norm

Yes that sounds right - basically we’d be not actually using the pretrained weights much at all in that case.

3 Likes