Universal NER: A Gold-Standard Multilingual Named Entity Recognition Benchmark

arXiv:2311.09122v2 Announce Type: replace
Abstract: We introduce Universal NER (UNER), an open, community-driven project to develop gold-standard NER benchmarks in many languages. The overarching goal of UNER is to provide high-quality, cross-lingually consistent annotations to facilitate and standardize multilingual NER research. UNER v1 contains 18 datasets annotated with named entities in a cross-lingual consistent schema across 12 diverse languages. In this paper, we detail the dataset creation and composition of UNER; we also provide initial modeling baselines on both in-language …

abstract annotations arxiv benchmark benchmarks community consistent cs.cl datasets languages multilingual ner project quality recognition research standard type universal