Meet Mish: New Activation function, possible successor to ReLU?

Okay now fit_fc is in the library and working. I’ll write some documentation tonight and probably ask the hive if I had missed something or if I should include anything else

Run !pip install git+https://github.com/fastai/fastai.git to grab the most recent version

Also if we wanted to train on the entire imagenet dataset (to provide a transfer learning model for everyone to use with mxnet) how would we go about grabbing that dataset?

5 Likes