Understanding the Effects of Iterative Prompting on Truthfulness

The development of Large Language Models (LLMs) has notably transformed numerous sectors, offering impressive text generation capabilities. Yet, the reliability and truthfulness of these models remain pressing concerns. To this end, we investigate iterative prompting, a strategy hypothesized to refine LLM responses, assessing its impact on LLM truthfulness, an area which has not been thoroughly explored. Our extensive experiments delve into the intricacies of iterative prompting variants, examining their influence on the accuracy and calibration of model responses. Our findings …

capabilities concerns cs.cl development effects impact iterative language language models large language large language models llm llms prompting refine reliability responses strategy text text generation understanding