all AI news
MLC: Bringing Open Large Language Models to Consumer Devices
May 22, 2023, 7:25 p.m. |
Simon Willison's Weblog simonwillison.net
MLC: Bringing Open Large Language Models to Consumer Devices
"We bring RedPajama, a permissive open language model to WebGPU, iOS, GPUs, and various other platforms." I managed to get this running on my Mac (see via link) with a few tweaks to their official instructions.
Via mlc-chat - RedPajama-INCITE-Chat-3B on macOS
ai chat consumer devices generativeai gpus homebrewllms ios language language model language models large language models llms mac macos managed mlc platforms redpajama running
More from simonwillison.net / Simon Willison's Weblog
Merge pull request #1757 from simonw/heic-heif
1 day, 2 hours ago |
simonwillison.net
Wrap text at specified width
1 day, 4 hours ago |
simonwillison.net
llm cmd undo last git commit - a new plugin for LLM
2 days, 16 hours ago |
simonwillison.net
GGML GGUF File Format Vulnerabilities
3 days, 1 hour ago |
simonwillison.net
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Principal Data Engineer
@ RS21 | Remote
SQL/Power BI Developer
@ ICF | Virginia Remote Office (VA99)
Senior Machine Learning Engineer (Canada Remote)
@ Fullscript | Ottawa, ON
Software Engineer - MLOps.
@ Renesas Electronics | Toyosu, Japan
Junior Data Scientist / Artificial Intelligence consultant
@ Deloitte | Luxembourg, LU