Hi all,
I wanted to share some of my utility functions I have built on top of MiniAI.
I wrote a blog about it.
I added functionalities like the printing time it took to train each epoch and changing the frequency of updating plots from batches to epochs/ or after fit.
It also has MyNorm, which is a mixture of BatchNorm and LayerNorm. It has the simplicity of LayerNorm that calculates statistics like BatchNorm. I found MyNorm to work as well as nn.BatchNorm2d on Fashion Mnist using Resnet, which was interesting.
I hope you find this blog useful. Thank you.