Opentensor and Cerebras announce BTLM-3B-8K, a 3 billion parameter state-of-the-art open-source language model that can fit on mobile devices

\[Note: I work for Cerebras\]

Cerebras and Opentensor announced at ICML today BTLM-3B-8K (Bittensor Language Model), a new state-of-the-art 3 billion parameter open-source language model that achieves leading accuracy across a dozen AI benchmarks.

BTLM fits on mobile and edge devices with as little as 3GB of memory, helping democratize AI access to billions of devices worldwide.

BTLM-3B-8K Highlights:-

* 7B level model performance in a 3B model
* State-of-the-art 3B parameter model
* Optimized for long sequence length inference …

accuracy ai benchmarks art benchmarks billion cerebras devices edge edge devices icml language language model languagetechnology mobile mobile devices state work