Researchers at Meta AI Introduce EditEval: An Instruction-Based Benchmark for Text Improvements

For various applications, including question answering, textual entailment, and summarization, large pre-trained language models have demonstrated excellent text production capabilities. However, most work using language models has concentrated on producing immutable text in a single pass. Contrasting this is the way humans naturally create texts, which is an iterative process of little phases, each serving a specific function. Often, a change is necessary only after a substantial portion of the text has been written, such as when reorganizing or eliminating …

benchmark languagetechnology meta meta ai researchers text