Evaluating Document Simplification: On the Importance of Separately Assessing Simplicity and Meaning Preservation

arXiv:2404.03278v1 Announce Type: new
Abstract: Text simplification intends to make a text easier to read while preserving its core meaning. Intuitively and as shown in previous works, these two dimensions (simplification and meaning preservation) are often-times inversely correlated. An overly conservative text will fail to simplify sufficiently, whereas extreme simplification will degrade meaning preservation. Yet, popular evaluation metrics either aggregate meaning preservation and simplification into a single score (SARI, LENS), or target meaning preservation alone (BERTScore, QuestEval). Moreover, these metrics …

abstract arxiv core cs.cl dimensions document importance meaning preservation simplicity text type will