Plug-and-Play Adaptation for Continuously-updated QA. (arXiv:2204.12785v1 [cs.CL])

Language models (LMs) have shown great potential as implicit knowledge bases
(KBs). And for their practical use, knowledge in LMs need to be updated
periodically. However, existing tasks to assess LMs' efficacy as KBs do not
adequately consider multiple large-scale updates. To this end, we first propose
a novel task--Continuously-updated QA (CuQA)--in which multiple large-scale
updates are made to LMs, and the performance is measured with respect to the
success in adding and updating knowledge while retaining existing knowledge. We …

arxiv qa