Thanks! I got some nice results with the Mish activation and Ranger, here: Meet Mish: New Activation function, possible successor to ReLU?
But curious to see how you did. I’m trying to train b5 now, but its seems trickier than b3!
Thanks! I got some nice results with the Mish activation and Ranger, here: Meet Mish: New Activation function, possible successor to ReLU?
But curious to see how you did. I’m trying to train b5 now, but its seems trickier than b3!