Web LLM runs the vicuna-7b Large Language Model entirely in your browser, and it's very impressive

A month ago I asked Could you train a ChatGPT-beating model for $85,000 and run it in a browser?. $85,000 was a hypothetical training cost for LLaMA 7B plus Stanford Alpaca. "Run it in a browser" was based on the fact that Web Stable Diffusion runs a 1.9GB Stable Diffusion model in a browser, so maybe it's not such a big leap to run a small Large Language Model there as well.

That second part has now happened.

Web …

ai alpaca big browser chatgpt chrome cost diffusion diffusion model generativeai homebrewllms language language model large language model llama llm llms part project small stable diffusion stanford training vicuna web webassembly