all AI news
Quoting James Betker
April 25, 2024, 5:13 a.m. |
Simon Willison's Weblog simonwillison.net
I’ve been at OpenAI for almost a year now. In that time, I’ve trained a lot of generative models. [...] It’s becoming awfully clear to me that these models are truly approximating their datasets to an incredible degree. [...] What this manifests as is – trained on the same dataset for long enough, pretty much every model with enough weights and training time converges to the same point. [...] This is a surprising observation! It implies that model behavior is …
clear dataset datasets every generative generativeai generative models james llms openai
More from simonwillison.net / Simon Willison's Weblog
I'm writing a new vector search SQLite Extension
1 day, 18 hours ago |
simonwillison.net
Printing music with CSS Grid
2 days, 6 hours ago |
simonwillison.net
We can have a different web
2 days, 18 hours ago |
simonwillison.net
Jobs in AI, ML, Big Data
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne