NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data

arXiv:2402.15343v1 Announce Type: cross
Abstract: Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use LLMs to create NuNER, a compact language representation model specialized in the Named Entity Recognition (NER) task. NuNER can be fine-tuned to solve downstream NER problems in a data-efficient way, outperforming similar-sized foundation models in the few-shot regime and competing with much larger LLMs. We …

abstract annotated data annotation arxiv cs.ai cs.cl cs.lg data data annotation encoder language language models large language large language models llm llms ner nlp paper pre-training recognition representation show solve the way training type via