Code Prompting Elicits Conditional Reasoning Abilities in Text+Code LLMs

arXiv:2401.10065v2 Announce Type: replace
Abstract: Reasoning is a fundamental component of language understanding. Recent prompting techniques, such as chain of thought, have consistently improved LLMs' performance on various reasoning tasks. Nevertheless, there is still little understanding of what triggers reasoning abilities in LLMs in the inference stage. In this paper, we introduce code prompting, a chain of prompts that transforms a natural language problem into code and directly prompts the LLM using the generated code without resorting to external code …

abstract arxiv chain of thought code code llms cs.cl inference language language understanding llms paper performance prompting reasoning stage tasks text thought type understanding