Document-aware Positional Encoding and Linguistic-guided Encoding for Abstractive Multi-document Summarization. (arXiv:2209.05929v1 [cs.CL])

One key challenge in multi-document summarization is to capture the relations
among input documents that distinguish between single document summarization
(SDS) and multi-document summarization (MDS). Few existing MDS works address
this issue. One effective way is to encode document positional information to
assist models in capturing cross-document relations. However, existing MDS
models, such as Transformer-based models, only consider token-level positional
information. Moreover, these models fail to capture sentences' linguistic
structure, which inevitably causes confusions in the generated summaries.
Therefore, in …

arxiv encoding positional encoding summarization