Educational Transformer from scratch (no Autograd)

I made an Educational Transformer from scratch I have been learning **Deep Learning and NLP** for a little while, and always found it hard to find full implementations of Transformers with **explicit forward and backprop**.

[This project](https://github.com/eduardoleao052/Transformer-from-scratch.git) was my attempt at building that. It is as well-documented as I could make it, and can be trained or fine-tuned easily by editing the **config.py** file and running the **run.py** script. Anyone can get the code with:

git clone https://github.com/eduardoleao052/Transformer-from-scratch.git

I managed …

autograd deep learning deeplearning educational found nlp transformer transformers