[R] Does anyone have access to an Attention visualization tool for generating Attention visualizations like the ones in the appendix of "Attention is All You Need"?

Since many copies of the paper don't have the appendix, here's one so you know what I'm talking about: [https://arxiv.org/pdf/1706.03762.pdf](https://arxiv.org/pdf/1706.03762.pdf)

In the appendix there are visualizations of connections generated by the attention mechanism, which "appear to exhibit behavior related to the syntactic and semantic structure of the sentences".

Does anyone know how these were generated, or have a tool or method that generates similar?

​

Thanks in advance!

advance attention behavior generated machinelearning semantic tool