CoUDA: Coherence Evaluation via Unified Data Augmentation

arXiv:2404.00681v1 Announce Type: new
Abstract: Coherence evaluation aims to assess the organization and structure of a discourse, which remains challenging even in the era of large language models. Due to the scarcity of annotated data, data augmentation is commonly used for training coherence evaluation models. However, previous augmentations for this task primarily rely on heuristic rules, lacking designing criteria as guidance. In this paper, we take inspiration from linguistic theory of discourse structure, and propose a data augmentation framework named …

abstract annotated data arxiv augmentation cs.cl data discourse evaluation however language language models large language large language models organization training type unified data via