LDB: A Large Language Model Debugger via Verifying Runtime Execution Step-by-step

arXiv:2402.16906v1 Announce Type: cross
Abstract: Large language models (LLMs) are leading significant progress in code generation. Beyond one-pass code generation, recent works further integrate unit tests and program verifiers into LLMs to iteratively refine the generated programs. However, these works consider the generated programs as an indivisible entity, which falls short for LLMs in debugging the programs, especially when the programs contain complex logic flows and data operations. In contrast, when human developers debug programs, they typically set breakpoints and …

abstract arxiv beyond code code generation cs.ai cs.cl cs.se debugger generated language language model language models large language large language model large language models llms progress refine step-by-step tests type via