I am building a Stacked Denoising Auto-Encoder with tied weights i.e weights of decoder are transpose of weights of encoder. I am unable to figure out what to do with the bias weights of the decoder. Does anyone have experience with this? Is it okay if I just leave the bias term out from the encoder also?
1 Like