all AI news
Grok-1 code and model weights release
March 17, 2024, 8:20 p.m. |
Simon Willison's Weblog simonwillison.net
Grok-1 code and model weights release
xAI have released their Grok-1 model under an Apache 2 license (for both weights and code). It's distributed as a 318.24G torrent file and likely requires 320GB of VRAM to run, so needs some very hefty hardware.
The accompanying blog post (via link) says "Trained from scratch by xAI using a custom training stack on top of JAX and Rust in October 2023", and describes it as a "314B parameter Mixture-of-Experts model with 25% …
ai apache blog code distributed file generativeai grok hardware license llms release scratch via xai
More from simonwillison.net / Simon Willison's Weblog
Managing your work in the API platform with Projects
1 day, 7 hours ago |
simonwillison.net
ChatGPT in "4o" mode is not running the new features yet
1 day, 8 hours ago |
simonwillison.net
Quoting Bruce Schneier
1 day, 13 hours ago |
simonwillison.net
Jobs in AI, ML, Big Data
Software Engineer for AI Training Data (School Specific)
@ G2i Inc | Remote
Software Engineer for AI Training Data (Python)
@ G2i Inc | Remote
Software Engineer for AI Training Data (Tier 2)
@ G2i Inc | Remote
Data Engineer
@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania
Artificial Intelligence – Bioinformatic Expert
@ University of Texas Medical Branch | Galveston, TX
Lead Developer (AI)
@ Cere Network | San Francisco, US