Exploring Language Model's Code Generation Ability with Auxiliary Functions

arXiv:2403.10575v1 Announce Type: cross
Abstract: Auxiliary function is a helpful component to improve language model's code generation ability. However, a systematic exploration of how they affect has yet to be done. In this work, we comprehensively evaluate the ability to utilize auxiliary functions encoded in recent code-pretrained language models. First, we construct a human-crafted evaluation set, called HumanExtension, which contains examples of two functions where one function assists the other. With HumanExtension, we design several experiments to examine their ability …

abstract arxiv code code generation cs.ai cs.cl cs.se exploration function functions however language language model language models type work