Building Blocks of Transformers: Attention

The Borrower, the Lender, and the Transformer: A Simple Look at Attention

It’s been 5 years…and the Transformer architecture seems almost untouchable. During all this time, there was no significant change in the structure behind a transformer. However, the world, for sure, has changed a lot because of it. We are now seeing amazing things achieved with this architecture. Starting from having simple conversations, to now controlling the device settings, everything was made possible by the same design.

architecture attention building change however look machine learning nlp programming simple transformer transformer architecture transformers world