(Chat)GPT v BERT: Dawn of Justice for Semantic Change Detection

arXiv:2401.14040v2 Announce Type: replace
Abstract: In the universe of Natural Language Processing, Transformer-based language models like BERT and (Chat)GPT have emerged as lexical superheroes with great power to solve open research problems. In this paper, we specifically focus on the temporal problem of semantic change, and evaluate their ability to solve two diachronic extensions of the Word-in-Context (WiC) task: TempoWiC and HistoWiC. In particular, we investigate the potential of a novel, off-the-shelf technology like ChatGPT (and GPT) 3.5 compared to …

abstract arxiv bert change chat cs.cl detection focus gpt justice language language models language processing natural natural language natural language processing paper power processing research semantic solve temporal the universe transformer type universe