[R] Language Models Can Teach Themselves to Program Better - Microsoft 2022

Paper: [https://arxiv.org/abs/2207.14502](https://arxiv.org/abs/2207.14502)

Abstract:

>This work shows how one can use large-scale language models (LMs) to synthesize programming problems with verified solutions, in the form of programming puzzles, which can then in turn be used to fine-tune those same models, improving their performance. This work builds on two recent developments. First, LMs have achieved breakthroughs in non-trivial reasoning and algorithm implementation, generating code that can solve some intermediate-level competitive programming problems. However, training code LMs involves curated sets of natural-language problem …

language language models machinelearning microsoft