[P] Educational Transformer without Autograd

I have been learning NLP for a little while, and always found it hard to find full implementations of Transformers with **explicit forward and backprop**. This project was my attempt at building that, while learning how to better understand optimization in Transformers.

It is as well-documented as I could make it, and can be trained or fine-tuned easily by editing the **config.py** file and running the **run.py** script. Get the code with:

git clone https://github.com/eduardoleao052/Transformer-from-scratch.git

I managed to generate some …

autograd building educational found machinelearning nlp optimization project transformer transformers