@jeremy I an reimplementing a keras model that uses weight regulatization kn only a few conv layers. Pytorch has the weight decay parameter that appears to apply to all weightsr. Does anyone know how these are related? And how I can achieve weight regulatization for only a few layers as in keras and not all the layers as in pytorch?