Meet Mish: New Activation function, possible successor to ReLU?

Not yet – I was going to wait until after I am finished with the project since this was just a small part of something much bigger. But I’ll definitely share it here when I do!

1 Like