PRP: Propagating Universal Perturbations to Attack Large Language Model Guard-Rails

arXiv:2402.15911v1 Announce Type: cross
Abstract: Large language models (LLMs) are typically aligned to be harmless to humans. Unfortunately, recent work has shown that such models are susceptible to automated jailbreak attacks that induce them to generate harmful content. More recent LLMs often incorporate an additional layer of defense, a Guard Model, which is a second LLM that is designed to check and moderate the output response of the primary LLM. Our key contribution is to show a novel attack strategy, …

abstract arxiv attacks automated cs.cl cs.cr defense generate humans jailbreak language language model language models large language large language model large language models layer llms rails them type universal work