Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities

arXiv:2309.16739v2 Announce Type: replace
Abstract: Large language models (LLMs), which have shown remarkable capabilities, are revolutionizing AI development and potentially shaping our future. However, given their multimodality, the status quo cloud-based deployment faces some critical challenges: 1) long response time; 2) high bandwidth costs; and 3) the violation of data privacy. 6G mobile edge computing (MEC) systems may resolve these pressing issues. In this article, we explore the potential of deploying LLMs at the 6G edge. We start by introducing …

abstract ai development arxiv bandwidth capabilities challenges cloud cloud-based costs cs.ai cs.lg deployment development edge future language language models large language large language models llms multimodality opportunities type vision