Subtoxic Questions: Dive Into Attitude Change of LLM's Response in Jailbreak Attempts

arXiv:2404.08309v1 Announce Type: cross
Abstract: As Large Language Models (LLMs) of Prompt Jailbreaking are getting more and more attention, it is of great significance to raise a generalized research paradigm to evaluate attack strengths and a basic model to conduct subtler experiments. In this paper, we propose a novel approach by focusing on a set of target questions that are inherently more sensitive to jailbreak prompts, aiming to circumvent the limitations posed by enhanced LLM security. Through designing and analyzing …

abstract arxiv attention attitude basic change cs.ai cs.cl cs.cr generalized jailbreak jailbreaking language language models large language large language models llm llms paper paradigm prompt questions raise research significance type