Sebastian, Basti, Wastl?! Recognizing Named Entities in Bavarian Dialectal Data

arXiv:2403.12749v1 Announce Type: new
Abstract: Named Entity Recognition (NER) is a fundamental task to extract key information from texts, but annotated resources are scarce for dialects. This paper introduces the first dialectal NER dataset for German, BarNER, with 161K tokens annotated on Bavarian Wikipedia articles (bar-wiki) and tweets (bar-tweet), using a schema adapted from German CoNLL 2006 and GermEval. The Bavarian dialect differs from standard German in lexical distribution, syntactic construction, and entity information. We conduct in-domain, cross-domain, sequential, and …

abstract articles arxiv cs.cl data dataset extract german information key ner paper recognition resources tokens tweet tweets type wikipedia