Lesson 7 In-Class Discussion

[pete.condon]

Lesson 6 In-Class Discussion

These are similar functions. https://brenocon.com/blog/2013/10/tanh-is-a-rescaled-logistic-sigmoid-function/

Lesson 6 In-Class Discussion

This is well described here: http://cs231n.github.io/neural-networks-1/ Short answer: tanh output is zero-centered, it makes gradient descent process easier to converge.