This is very nice Josh, thanks! I wonder if there’s some way to programatically include this info during model training; maybe using the callback structure to check the “activation density” and adjust the LR accordingly…
@JoshVarty, @NathanHub, just so you know there’s a group of people talking about fastai for audio over on the Deep Learning with Audio Thread - pop in and check it out 