all AI news
Delimiters won't save you from prompt injection
Simon Willison's Weblog simonwillison.net
Prompt injection remains an unsolved problem. The best we can do at the moment, disappointingly, is to raise awareness of the issue. As I pointed out last week, "if you don’t understand it, you are doomed to implement it."
There are many proposed solutions, and because prompting is a weirdly new, non-deterministic and under-documented field, it's easy to assume that these solutions are effective when they actually aren't.
The simplest of those is to use delimiters to mark the …
ai generativeai issue llms openai prompt promptengineering prompting prompt injection promptinjection save security solutions