Mitigating Misleading Chain-of-Thought Reasoning with Selective Filtering

arXiv:2403.19167v1 Announce Type: new
Abstract: Large language models have manifested remarkable capabilities by leveraging chain-of-thought (CoT) reasoning techniques to solve intricate questions through step-by-step reasoning chains. Despite its success, the efficacy of such reasoning is inherently contingent upon the quality of CoT. However, flawless CoT reasoning cannot be guaranteed due to the presence of indecomposable questions and the potential for erroneous reasoning chains, particularly in the case of small-scale language models. To tackle this challenge, we propose a novel approach …

arxiv cs.ai cs.cl filtering reasoning thought type