SoLA: Solver-Layer Adaption of LLM for Better Logic Reasoning

arXiv:2402.11903v1 Announce Type: new
Abstract: Considering the challenges faced by large language models (LLMs) on logical reasoning, prior efforts have sought to transform problem-solving through tool learning. While progress has been made on small-scale problems, solving industrial cases remains difficult due to their large scale and intricate expressions. In this paper, we propose a novel solver-layer adaptation (SoLA) method, where we introduce a solver as a new layer of the LLM to differentially guide solutions towards satisfiability. In SoLA, LLM …

abstract arxiv cases challenges cs.ai cs.cl industrial language language models large language large language models layer llm llms logic paper prior problem-solving progress reasoning scale small solver through tool type