NoTorch

A 'from scratch' implementation of a deep learning library (no pytorch/tensorflow) built only on NumPy.

This is a learning project heavily inspired by and based on Andrej Karpathy's micrograd: https://github.com/karpathy/micrograd

FEATURES:

• A matrix valued autograd engine, allowing for 24 (and counting) differentiable matrix operations

• Neural Networks

• Transformers

• Extremely fast performance, speeds similar to PyTorch. Orders of magnitude faster than micrograd (see speed_test.py)

IN PROGRESS:

• GPU support via CuPy

How to Use

Install poetry: https://python-poetry.org/docs/#installation

To run speed_test.py: (OSX/Linux)

$ git clone https://github.com/Lucasc-99/NoTorch
$ cd NoTorch
$ poetry install 
$ poetry run python speed_test.py