Small Language Model Is a Good Guide for Large Language Model in Chinese Entity Relation Extraction

arXiv:2402.14373v1 Announce Type: new
Abstract: Recently, large language models (LLMs) have been successful in relational extraction (RE) tasks, especially in the few-shot learning. An important problem in the field of RE is long-tailed data, while not much attention is currently paid to this problem using LLM approaches. Therefore, in this paper, we propose SLCoLM, a model collaboration framework, to mitigate the data long-tail problem. In our framework, We use the ``\textit{Training-Guide-Predict}'' strategy to combine the strengths of pre-trained language models …

abstract arxiv attention chinese cs.cl data extraction few-shot few-shot learning good guide language language model language models large language large language model large language models llms relational small small language model tasks type