all AI news
SelF-Eval: Self-supervised Fine-grained Dialogue Evaluation. (arXiv:2208.08094v1 [cs.CL])
Aug. 18, 2022, 1:11 a.m. | Longxuan Ma, Ziyu Zhuang, Weinan Zhang, Mingda Li, Ting Liu
cs.CL updates on arXiv.org arxiv.org
This paper introduces a novel Self-supervised Fine-grained Dialogue
Evaluation framework (SelF-Eval). The core idea is to model the correlation
between turn quality and the entire dialogue quality. We first propose a novel
automatic data construction method that can automatically assign fine-grained
scores for arbitrarily dialogue data. Then we train \textbf{SelF-Eval} with a
multi-level contrastive learning schema which helps to distinguish different
score levels. Experimental results on multiple benchmarks show that SelF-Eval
is highly consistent with human evaluations and better than …
More from arxiv.org / cs.CL updates on arXiv.org
Jobs in AI, ML, Big Data
Data Scientist (m/f/x/d)
@ Symanto Research GmbH & Co. KG | Spain, Germany
Data Analyst, Tableau
@ NTT DATA | Bengaluru, KA, IN
Junior Machine Learning Researcher
@ Weill Cornell Medicine | Doha, QA, 24144
Marketing Data Analytics Intern
@ Sloan | Franklin Park, IL, US, 60131
Senior Machine Learning Scientist
@ Adyen | Amsterdam
Data Engineer
@ Craft.co | Warsaw, Mazowieckie