Development of a rule-based lemmatization algorithm through Finite State Machine for Uzbek language. (arXiv:2210.16006v1 [cs.CL])

Lemmatization is one of the core concepts in natural language processing,
thus creating a lemmatization tool is an important task. This paper discusses
the construction of a lemmatization algorithm for the Uzbek language. The main
purpose of the work is to remove affixes of words in the Uzbek language by
means of the finite state machine and to identify a lemma (a word that can be
found in the dictionary) of the word. The process of removing affixes uses a …

algorithm arxiv development finite state machine language lemmatization machine state