Evaluating Shortest Edit Script Methods for Contextual Lemmatization

arXiv:2403.16968v1 Announce Type: new
Abstract: Modern contextual lemmatizers often rely on automatically induced Shortest Edit Scripts (SES), namely, the number of edit operations to transform a word form into its lemma. In fact, different methods of computing SES have been proposed as an integral component in the architecture of several state-of-the-art contextual lemmatizers currently available. However, previous work has not investigated the direct impact of SES in the final lemmatization performance. In this paper we address this issue by focusing …

abstract architecture art arxiv computing cs.cl edit form integral lemmatization modern operations scripts ses state type word