Meta Open-Sources Code Generation LLM Code Llama

Meta recently open-sourced Code Llama, a code generation LLM which is based on the Llama 2 foundation model and carries the same community license. Code Llama was fine-tuned on 500B tokens of code and is available in three model sizes ranging up to 34B parameters. In evaluations on code-generation benchmarks, the model outperformed all other open-source models and is comparable to ChatGPT.

ai benchmarks code code generation code llama community foundation foundation model generative-ai large language models license llama llama 2 llm meta ml & data engineering tokens