Good readings 2019

I found the experiments from Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask interesting:

https://eng.uber.com/deconstructing-lottery-tickets/

The authors found that after training the LT networks, preserving the signs of weights and keeping the weights that are away from zeros using the supermask can draw out good performance (80 percent test accuracy on MNIST and 24 percent on CIFAR-10) without additional training.

1 Like