Open-source Fine-Tuning on Codebase with Refact

Code completion has become increasingly popular, thanks to tools like GitHub Copilot and open-source Large Language Models (LLMs). However, both Copilot and open models often fall short when it comes to working effectively on your specific codebase. This is because these models have never been exposed to your unique code patterns and conventions.

In order to improve the quality of suggestions and tailor them to your codebase there's a technique called fine-tuning. By fine-tuning a pre-trained model on your codebase, …

ai become code codebase code completion copilot fine-tuning github language language models large language large language models llm llms opensource patterns popular tools