[R] OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement - 2024 - HumanEval of 92.7! GPT-4 CodeInterpreter has only 88.0!

Paper: [https://arxiv.org/abs/2402.14658](https://arxiv.org/abs/2402.14658)

Github: [https://opencodeinterpreter.github.io/](https://opencodeinterpreter.github.io/)

Abstract:

>The introduction of large language models has significantly advanced code generation. However, open-source models often lack the execution capabilities and iterative refinement of advanced systems like the GPT-4 Code Interpreter. To address this, we introduce **OpenCodeInterpreter, a family of open-source code systems designed for generating, executing, and iteratively refining code.** Supported by Code-Feedback, a dataset featuring 68K multi-turn interactions, OpenCodeInterpreter integrates execution and human feedback for dynamic code refinement. Our comprehensive evaluation of OpenCodeInterpreter across …

abstract advanced capabilities code code generation dataset family feedback gpt gpt-4 interactions interpreter introduction iterative language language models large language large language models machinelearning open-source models systems