Novi jezi\v{c}ki modeli za srpski jezik

arXiv:2402.14379v1 Announce Type: new
Abstract: The paper will briefly present the development history of transformer-based language models for the Serbian language. Several new models for text generation and vectorization, trained on the resources of the Society for Language Resources and Technologies, will also be presented. Ten selected vectorization models for Serbian, including two new ones, will be compared on four natural language processing tasks. Paper will analyze which models are the best for each selected task, how does their size …

abstract arxiv cs.cl development history language language models language resources paper resources society technologies text text generation transformer type vectorization will