s
May 3, 2023, 8:58 p.m. |

Simon Willison's Weblog simonwillison.net

OpenLLaMA


The first openly licensed model I've seen trained on the RedPajama dataset. This initial release is a 7B model trained on 200 billian tokens, but the team behind it are promising a full 1 trillion token model in the near future. I haven't found a live demo of this one running anywhere yet.

ai dataset demo future generativeai homebrewllms llama llms near redpajama release running team tokens

Lead Developer (AI)

@ Cere Network | San Francisco, US

Research Engineer

@ Allora Labs | Remote

Ecosystem Manager

@ Allora Labs | Remote

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote