Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Again. (arXiv:2203.08410v2 [cs.CL] UPDATED)

The strong few-shot in-context learning capability of large pre-trained
language models (PLMs) such as GPT-3 is highly appealing for application
domains such as biomedicine, which feature high and diverse demands of language
technologies but also high data annotation costs. In this paper, we present the
first systematic and comprehensive study to compare the few-shot performance of
GPT-3 in-context learning with fine-tuning smaller (i.e., BERT-sized) PLMs on
two highly representative biomedical information extraction tasks, named entity
recognition and relation extraction. We …

arxiv biomedical context gpt gpt-3 learning think thinking