How Important is Domain Specificity in Language Models and Instruction Finetuning for Biomedical Relation Extraction?

arXiv:2402.13470v1 Announce Type: new
Abstract: Cutting edge techniques developed in the general NLP domain are often subsequently applied to the high-value, data-rich biomedical domain. The past few years have seen generative language models (LMs), instruction finetuning, and few-shot learning become foci of NLP research. As such, generative LMs pretrained on biomedical corpora have proliferated and biomedical instruction finetuning has been attempted as well, all with the hope that domain specificity improves performance on downstream tasks. Given the nontrivial effort in …

abstract arxiv become biomedical cs.cl data domain edge extraction few-shot few-shot learning finetuning general generative language language models lms nlp research specificity type value