Hey team,
I wanted to collect your wisdom on what steps you usually take when a neural net on a given dataset seems impossible to train. I’m currently working on classifying audio spectrograms into 176 categories, but my accuracy just doesn’t go above random guesses.
Jeremy touches this topic in one of the lessons mentioning that starting with a very low LR for a couple of epochs and then increasing the LR back again can do some good. I’ve never fully understand why this is and sadly it doesn’t seem to work in my current project.
Any other ideas? I dont think I made any mistakes when preprocessing the data and other people solved this problem using similar architectures
Thank You