[Project] godot-dodo - Finetuning LLaMA on single-language comment:code data pairs

[GitHub Repository (godot-dodo)](https://github.com/minosvasilias/godot-dodo)

This repository presents finetuned LLaMA models that try to address the limited ability of existing language models when it comes to generating code for less popular programming languages.


`gpt-3.5-turbo` and `gpt-4` have proven to be excellent coders, but fall off sharply when asked to generate code for languages other than `Python`/`Javascript` etc.
The `godot-dodo` approach to address this: Finetune smaller models on a single one of these languages, using human-created code scraped from MIT-licensed GitHub repositories, with …

alpaca code coders data dataset dataset generation etc github godot gpt gpt-3 gpt-3.5 gpt-4 human javascript language language models languages llama machinelearning mit popular popular programming languages programming programming languages project projects python stanford