Look Before You Leap: Problem Elaboration Prompting Improves Mathematical Reasoning in Large Language Models

arXiv:2402.15764v1 Announce Type: new
Abstract: Large language models~(LLMs) have exhibited impressive performance across NLP tasks. So far they still face challenges in complex reasoning tasks and can be sensitive to input context. Despite significant efforts have been invested in enhancing reasoning process and improving prefix-prompts robustness, the crucial role of problem context has been overlooked. In this study, we propose a new approach to improve the mathematical capacities of LLMs, named Problem Elaboration Prompting~(PEP). Specifically, PEP decomposes and elucidates the …

abstract arxiv challenges context cs.ai cs.cl face language language models large language large language models llms look mathematical reasoning nlp performance process prompting prompts reasoning robustness tasks type