New Transformer architecture could enable powerful LLMs without GPUs

MatMul-free LM removes matrix multiplications from language model architectures to make them faster and much more memory-efficient.
MatMul-free LM removes matrix multiplications from language model architectures to make them faster and much more memory-efficient.Read More