all AI news
Dusting off my blog, and Machine Learning
March 20, 2023, 6:41 p.m. | Eric Hartford
Playing with AI erichartford.com
It's been a while. And I'm digging into Machine Learning.
I was watching the excellent video by Andrej Karpathy about how to write a GPT (of which GPT-3 is an example) from scratch, using the paper "Attention is all you need"
I implemented it from scratch while watching the video, and also refactored and added some features to make it better.
My code is located here:
What's this do?
- Generates fake Shakespearean text (could be trained on any text …
andrej karpathy attention attention is all you need blog example gpt gpt-3 machine machine learning paper video
More from erichartford.com / Playing with AI
From Zero to Fineturning with Axolotl on ROCm
2 months ago |
erichartford.com
dolphin-2.5-mixtral-8x7b
4 months, 3 weeks ago |
erichartford.com
Running Dolphin Locally with Ollama
5 months, 1 week ago |
erichartford.com
GPT-4's rebuttal to Uncensored Models
11 months, 3 weeks ago |
erichartford.com
Jobs in AI, ML, Big Data
Data Engineer
@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania
Artificial Intelligence – Bioinformatic Expert
@ University of Texas Medical Branch | Galveston, TX
Lead Developer (AI)
@ Cere Network | San Francisco, US
Research Engineer
@ Allora Labs | Remote
Ecosystem Manager
@ Allora Labs | Remote
Founding AI Engineer, Agents
@ Occam AI | New York