all AI news
[P] godot-dodo – Finetuning starcoder on single-language instruction data
May 26, 2023, 10:50 p.m. | /u/_Minos
Machine Learning www.reddit.com
https://preview.redd.it/aycz97t3pa2b1.png?width=1920&format=png&auto=webp&v=enabled&s=cba7369dbce8d1eb5402e97ef8e6cb0f7d3b6d59
Starcoder performs significantly better than LLaMA using the same dataset, and exceeds GDScript evaluation scores of both gpt-4 and gpt-3.5-turbo, showing that single-language finetunes of smaller models may be a competitive option for coding assistants, especially for less commonplace languages such as GDScript.
These models also illustrate some drawbacks of the current approach, namely increasing occurrences of the model …
assistants coding dataset evaluation gpt gpt-3 gpt-3.5 gpt-4 language languages llama machinelearning starcoder
More from www.reddit.com / Machine Learning
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Director, Global Procurement Data Analytics
@ Alcon | Fort Worth - Main
Backend Software Engineer, Airbnb for Real Estate
@ Airbnb | United States
Data Scientist
@ Exoticca | Barcelona, Catalonia, Spain - Remote
ESG Data Analytics Summer Associate (Intern)
@ Apex Clean Energy | Charlottesville, VA, United States
Team Lead, Machine Learning
@ Prenuvo | Vancouver, British Columbia, Canada