Help with backpropagation Implementation in basic Neural Network

Hi Everyone,

I have implemented a 2 layers NN from scratch using Softmax cross-entropy loss, but my NN is not working properly, the Training accuracy is not decreasing.

I am implementing the batch version and the matrix dimensions match.

Can someone please help?

Below is the network architecture and formulas used for backpropagation.

Thank You very much