I have implemented a 2 layers NN from scratch using Softmax cross-entropy loss, but my NN is not working properly, the Training accuracy is not decreasing.
I am implementing the batch version and the matrix dimensions match.
Can someone please help?
Below is the network architecture and formulas used for backpropagation.
Thank You very much