A Complete Guide to Write your own Transformers

An end-to-end implementation of a Pytorch Transformer, in which we will cover key concepts such as self-attention, encoders, decoders, and much more.

Writing our own

When I decided to dig deeper into Transformer architectures, I often felt frustrated when reading or watching tutorials online as I felt they always missed something :

• Official tutorials from Tensorflow or Pytorch used their own APIs, thus staying high-level and forcing me to have to go in …

data science deep-dives machine learning pytorch transformers