Prompt Engineering a Prompt Engineer

arXiv:2311.05661v2 Announce Type: replace-cross
Abstract: Prompt engineering is a challenging yet crucial task for optimizing the performance of large language models on customized tasks. It requires complex reasoning to examine the model's errors, hypothesize what is missing or misleading in the current prompt, and communicate the task with clarity. While recent works indicate that large language models can be meta-prompted to perform automatic prompt engineering, we argue that their potential is limited due to insufficient guidance for complex reasoning in …

abstract arxiv cs.ai cs.cl cs.lg current engineer engineering errors language language models large language large language models performance prompt prompt engineer reasoning tasks type