Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection

arXiv:2307.16888v3 Announce Type: replace-cross
Abstract: Instruction-tuned Large Language Models (LLMs) have become a ubiquitous platform for open-ended applications due to their ability to modulate responses based on human instructions. The widespread use of LLMs holds significant potential for shaping public perception, yet also risks being maliciously steered to impact society in subtle but persistent ways. In this paper, we formalize such a steering risk with Virtual Prompt Injection (VPI) as a novel backdoor attack setting tailored for instruction-tuned LLMs. In …

arxiv cs.cl cs.cr cs.lg instruction-tuned language language models large language large language models prompt prompt injection type virtual