Improving LLM Code Generation with Grammar Augmentation

arXiv:2403.01632v1 Announce Type: new
Abstract: We present SynCode a novel framework for efficient and general syntactical decoding of code with large language models (LLMs). SynCode leverages the grammar of a programming language, utilizing an offline-constructed efficient lookup table called DFA mask store based on language grammar terminals. We demonstrate SynCode's soundness and completeness given the context-free grammar (CFG) of the programming language, presenting its ability to retain syntactically valid tokens while rejecting invalid ones. The framework seamlessly integrates with any …

abstract arxiv augmentation code code generation cs.fl cs.lg cs.pl cs.se decoding framework general grammar language language models large language large language models llm llms novel offline programming programming language store table type