1-bit LLMs Could Solve AI’s Energy Demands

Large language models, the AI systems that power chatbots like ChatGPT, are getting better and better—but they’re also getting bigger and bigger, demanding more energy and computational power. For LLMs that are cheap, fast, and environmentally friendly, they’ll need to shrink, ideally small enough to run directly on devices like cell phones. Researchers are finding ways to do just that by drastically rounding off the many high-precision numbers that store their memories to equal just 1 or -1.

LLMs, like …

ai systems artificial intelligence bigger chatbots chatgpt computational devices energy language language models large language large language models llama llms meta phones power researchers small solve systems