Hello everyone, I have written a blog post on the types of activation functions in neural networks. It suggests the type of activation function to use and also highlights some of the recent developments in activation functions.
You can find it here -
Which activation function to use in neural networks?
Hope you would find it informative. Any suggestions are most welcome.