Neural Network Loss Remains Constant

I tried implementing a neural net from scratch (as in lecture 8).
Can a good samaritan please help me why is the loss not decreasing after 2 iterations.
Is there something wrong with the code?

Here is the link to my notebook.
Please feel free to edit it and experiment!