s
Nov. 8, 2023, 2:44 a.m. |

Simon Willison's Weblog simonwillison.net

Fine-tuning GPT3.5-turbo based on 140k slack messages


Ross Lazerowitz spent $83.20 creating a fine-tuned GPT-3.5 turbo model based on 140,000 of his Slack messages (10,399,747 tokens), massaged into a JSONL file suitable for use with the OpenAI fine-tuning API.

Then he told the new model "write a 500 word blog post on prompt engineering", and it replied "Sure, I shall work on that in the morning".

ai api blog engineering fine-tuning finetuning generativeai gpt gpt-3 gpt3 gpt-3.5 gpt3.5 llms messages openai prompt slack tokens turbo word

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Principal Machine Learning Engineer (AI, NLP, LLM, Generative AI)

@ Palo Alto Networks | Santa Clara, CA, United States

Consultant Senior Data Engineer F/H

@ Devoteam | Nantes, France