Quiz Design Task: Helping Teachers Create Quizzes with Automated Question Generation. (arXiv:2205.01730v1 [cs.CL])

Web: http://arxiv.org/abs/2205.01730

Question generation (QGen) models are often evaluated with standardized NLG
metrics that are based on n-gram overlap. In this paper, we measure whether
these metric improvements translate to gains in a practical setting, focusing
on the use case of helping teachers automate the generation of reading
comprehension quizzes. In our study, teachers building a quiz receive question
suggestions, which they can either accept or refuse with a reason. Even though
we find that recent progress in QGen leads to a …

arxiv design quiz