all AI news
EditEval: An Instruction-Based Benchmark for Text Improvements. (arXiv:2209.13331v1 [cs.CL])
Sept. 28, 2022, 1:16 a.m. | Jane Dwivedi-Yu, Timo Schick, Zhengbao Jiang, Maria Lomeli, Patrick Lewis, Gautier Izacard, Edouard Grave, Sebastian Riedel, Fabio Petroni
cs.CL updates on arXiv.org arxiv.org
Evaluation of text generation to date has primarily focused on content
created sequentially, rather than improvements on a piece of text. Writing,
however, is naturally an iterative and incremental process that requires
expertise in different modular skills such as fixing outdated information or
making the style more consistent. Even so, comprehensive evaluation of a
model's capacity to perform these skills and the ability to edit remains
sparse. This work presents EditEval: An instruction-based, benchmark and
evaluation suite that leverages high-quality …
More from arxiv.org / cs.CL updates on arXiv.org
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Data Scientist
@ Motive | India - Remote
Senior Perception Engineer
@ NVIDIA | US, CA, Santa Clara
Business Data Analyst, Finance and Treasury Data Repositories, Senior Associate
@ State Street | Krakow, Poland
Junior AI Engineer (Internship)
@ Sony | SEU - Italy - Roma
Manager, Data Science 3
@ PayPal | USA - Pennsylvania - Virtual