Sept. 5, 2023, 10:15 a.m. | Refact AI

DEV Community dev.to

Today we're introducing Refact LLM: 1.6B code model with infill real-time code completion (including fill-in-the-middle(FIM) capability) and chat.

Refact LLM achieves the state-of-the-art performance among the code LLMs, coming closer to HumanEval as Starcoder, being 10x smaller in size, and it beats other code models such as StableCode, CodeGen and ReplitCode on HumanEval metric.


Summary:



  • 1.6b parameters

  • 20 programming languages

  • 4096 tokens context

  • code completion and chat capabilities

  • SoTA on HumanEval benchmark among similar code models

  • pre-trained on permissive …

ai art capability chat code code completion code llms copilot free githubcopilot humaneval llm llms performance programming real-time small starcoder state

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Robotics Technician - 3rd Shift

@ GXO Logistics | Perris, CA, US, 92571