Learning Planning-based Reasoning by Trajectories Collection and Process Reward Synthesizing

Large Language Models (LLMs) have demonstrated significant potential in handling complex reasoning tasks through step-by-step rationale generation. However, recent studies have raised concerns regarding the hallucination and flaws in their reasoning process. Substantial efforts are being made to improve the reliability and faithfulness of the generated rationales. Some approaches model reasoning as planning, while others focus on annotating for process supervision. Nevertheless, the planning-based search process often results in high latency due to the frequent assessment of intermediate reasoning states …

collection concerns cs.ai cs.cl flaws generated hallucination language language models large language large language models llms planning process reasoning reliability step-by-step studies tasks through