DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence. (arXiv:2201.11176v1 [cs.CL])

Web: http://arxiv.org/abs/2201.11176

Recently has there been a growing interest in the creation of text generation
systems from a discourse coherence perspective, e.g., modeling the
interdependence between sentences. Still, recent BERT-based evaluation metrics
cannot recognize coherence and fail to punish incoherent elements in system
outputs. In this work, we introduce DiscoScore, a discourse metric with
multiple variants, which uses BERT to model discourse coherence from different
perspectives, driven by Centering theory. Our experiments encompass 16
non-discourse and discourse metrics, including DiscoScore and popular …

arxiv bert text text generation