[N] StarCoder: A State-of-the-Art LLM for Code

[https://huggingface.co/blog/starcoder](https://huggingface.co/blog/starcoder)

>StarCoder and StarCoderBase are Large Language Models for Code (Code LLMs) trained on permissively licensed data from GitHub, including from 80+ programming languages, Git commits, GitHub issues, and Jupyter notebooks. Similar to LLaMA, we trained a \~15B parameter model for 1 trillion tokens. We fine-tuned StarCoderBase model for 35B Python tokens, resulting in a new model that we call StarCoder.

call code code llms data git github jupyter jupyter notebooks language language models languages large language models llama llms machinelearning notebooks programming programming languages python starcoder tokens