Quantum linear algebra is all you need for Transformer architectures

arXiv:2402.16714v1 Announce Type: cross
Abstract: Generative machine learning methods such as large-language models are revolutionizing the creation of text and images. While these models are powerful they also harness a large amount of computational resources. The transformer is a key component in large language models that aims to generate a suitable completion of a given partial sequence. In this work, we investigate transformer architectures under the lens of fault-tolerant quantum computing. The input model is one where pre-trained weight matrices …

abstract algebra architectures arxiv computational cs.ai cs.cl generate generative harness images key language language models large language large language models linear linear algebra machine machine learning quant-ph quantum resources text transformer type