Loss increasing for every iteration

Part 2 & Alumni (2018)
1

I wrote a RNN from scratch in numpy and I am not sure if the backpropogation equations were correct but my loss function increases for every iteration.