LLeMpower: Understanding Disparities in the Control and Access of Large Language Models

arXiv:2404.09356v1 Announce Type: cross
Abstract: Large Language Models (LLMs) are a powerful technology that augment human skill to create new opportunities, akin to the development of steam engines and the internet. However, LLMs come with a high cost. They require significant computing resources and energy to train and serve. Inequity in their control and access has led to concentration of ownership and power to a small collection of corporations. In our study, we collect training and inference requirements for various …

abstract access arxiv computing computing resources control cost create cs.ai cs.cl cs.cy cs.et development energy however human internet language language models large language large language models llms opportunities resources steam technology train type understanding