Prompt Stealing Attacks Against Large Language Models

arXiv:2402.12959v1 Announce Type: cross
Abstract: The increasing reliance on large language models (LLMs) such as ChatGPT in various fields emphasizes the importance of ``prompt engineering,'' a technology to improve the quality of model outputs. With companies investing significantly in expert prompt engineers and educational resources rising to meet market demand, designing high-quality prompts has become an intriguing challenge. In this paper, we propose a novel attack against LLMs, named prompt stealing attacks. Our proposed prompt stealing attack aims to steal …

abstract arxiv attacks chatgpt companies cs.cl cs.cr demand designing educational engineering engineers expert fields importance investing language language models large language large language models llms prompt prompt engineers prompts quality reliance resources stealing technology type