Share your work here (Part 2)

[ste (Stefano Giomo)]

The "colorful" dimension

TL;DR The idea of the colorful dimension is to express with colors the mean and standard deviation of activations for each batch during training. Vertical axis represents a group (bin) of activation values. Each column in the horizontal axis is a batch. The colours represent how many activations for that batch have a value in that bin. [image] NB: Actual plot shown by Jeremy in the lesson are much more curated and focused. This post is about the original idea and my attempt to implement it. D…

Thnx to @alexli, @simonjhb, @ThomM, @zachcaceres