I developed NEOGRAD - A deep learning framework created from scratch with Python and NumPy

Deep Learning
1

Hey everyone! I’m Pranav, a junior studying CSE at BMSCE, Bengaluru, India.

  • I developed neograd, a deep learning framework created from scratch using Python and NumPy with PyTorch like API
  • It has autograd (automatic differentiation), which supports scalars, vectors and matrices and calculates all their gradients for you automatically during the backward pass. It is also fully NumPy broadcasting compatible.
  • Layers like Linear, 2D, 3D Convolutions and MaxPooling, activations like ReLU, Sigmoid, Softmax, Tanh layers all built from the ground up.
  • It can also save and load models, parameters to and from disk.
  • Many popular optimization algorithms like Adam, RMSProp, Momentum are included

I initially built this to understand how automatic differentiation works under the hood in PyTorch, but later on extended it to a complete framework. This was developed as an educational tool in order for beginners to understand how things work under the hood in giant frameworks like PyTorch, with code that is intuitive and easily readable. I just released v0.0.3 today.
I’m looking for feedback on what more features I can add and what can be improved.

Please checkout the github repo at https://github.com/pranftw/neograd

Colab Notebooks to get started

Thanks!

digits

optims

ng
ng502×502 22.3 KB

5 Likes
2

Really cool project

3

I would like to contribute as a way of documenting my learning. Can you move to nbdev?

4

Thanks!

5

I’ll think about it. I’m not that familiar with nbdev

1 Like