New Transformer architecture could enable powerful LLMs without GPUs

MatMul-free LM removes matrix multiplications from language model architectures to make them faster and much more memory-efficient.

ai architecture architectures business computer science computers & electronics faster free gpu gpus language language model language models llms matrix memory ml and deep learning research science them transformer transformer architecture