Good People of r/datascience, how would you explain BERT/Transformer architecture in a single paragraph?

As much as I appreciate good humour, I'm not looking for street-smart answers like 'Here's the thing, I can't' or 'Matrix Multiplication uWu'. I kinda want this discussion to be a place for juniors like me to learn from the pros here.

architecture bert datascience good people transformer transformer architecture