Another interactive visualization toolkit for neural networks. You can also see various activations as you draw the number in real-time. They have used MNIST for the paper.
http://scs.ryerson.ca/~aharley/vis/
These kind of visualizations provide more intuition into what’s happening under the hood.