Distilling Algorithmic Reasoning from LLMs via Explaining Solution Programs

arXiv:2404.08148v1 Announce Type: new
Abstract: Distilling explicit chain-of-thought reasoning paths has emerged as an effective method for improving the reasoning abilities of large language models (LLMs) across various tasks. However, when tackling complex tasks that pose significant challenges for state-of-the-art models, this technique often struggles to produce effective chains of thought that lead to correct answers. In this work, we propose a novel approach to distill reasoning abilities from LLMs by leveraging their capacity to explain solutions. We apply our …

abstract art arxiv challenges cs.cl however improving language language models large language large language models llms reasoning solution state state-of-the-art models tasks thought type via