Software Mention Recognition with a Three-Stage Framework Based on BERTology Models at SOMD 2024

arXiv:2405.01575v1 Announce Type: cross
Abstract: This paper describes our systems for the sub-task I in the Software Mention Detection in Scholarly Publications shared-task. We propose three approaches leveraging different pre-trained language models (BERT, SciBERT, and XLM-R) to tackle this challenge. Our bestperforming system addresses the named entity recognition (NER) problem through a three-stage framework. (1) Entity Sentence Classification - classifies sentences containing potential software mentions; (2) Entity Extraction - detects mentions within classified sentences; (3) Entity Type Classification - categorizes …

abstract arxiv bert challenge cs.ai cs.cl cs.se detection framework language language models paper publications recognition software stage systems type