Are Large Pre-Trained Language Models Leaking Your Personal Information?. (arXiv:2205.12628v1 [cs.CL])

Large Pre-Trained Language Models (PLMs) have facilitated and dominated many
NLP tasks in recent years. However, despite the great success of PLMs, there
are also privacy concerns brought with PLMs. For example, recent studies show
that PLMs memorize a lot of training data, including sensitive information,
while the information may be leaked unintentionally and be utilized by
malicious attackers.

In this paper, we propose to measure whether PLMs are prone to leaking
personal information. Specifically, we attempt to query PLMs …

arxiv information language language models