Knowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language Models

arXiv:2305.09955v3 Announce Type: replace
Abstract: By design, large language models (LLMs) are static general-purpose models, expensive to retrain or update frequently. As they are increasingly adopted for knowledge-intensive tasks, it becomes evident that these design choices lead to failures to generate factual, relevant, and up-to-date knowledge. To this end, we propose Knowledge Card, a modular framework to plug in new factual and relevant knowledge into general-purpose LLMs. We first introduce knowledge cards -- specialized language models trained on corpora from …

abstract arxiv card cs.cl design general generate knowledge language language models large language large language models llms tasks type update