Hey guys!
Just recently joined Fast AI and this community has been extremely rewarding to me, thanks to @jeremy and all other members. Since this forum is about sharing individual projects, I am glad to showcase my research project where I designed a novel activation function called Mish which beats other SOTA activation functions. Mish was also used to beat several leaderboard scores on Fast AI ImageNette and ImageWoof leaderboards. There is a dedicated Fast AI forum on Mish - Meet Mish: New Activation function, possible successor to ReLU?
The link to the GitHub repository - https://github.com/digantamisra98/Mish
The repository also contains the link to the paper. Feel free to try it out and provide any feedback. Thanks!