AMR Alignment: Paying Attention to Cross-Attention. (arXiv:2206.07587v1 [cs.CL])

Web: http://arxiv.org/abs/2206.07587

With the surge of Transformer models, many have investigated how attention
acts on the learned representations. However, attention is still overlooked for
specific tasks, such as Semantic Parsing. A popular approach to the formal
representation of a sentence's meaning is Abstract Meaning Representation
(AMR). Until now, the alignment between a sentence and its AMR representation
has been explored in different ways, such as through rules or via the
Expectation Maximization (EM) algorithm. In this paper, we investigate the
ability of …

arxiv attention cross