Matrix Multiplication on the GPU

Matrix Multiplication on GPU

How to achieve state-of-the-art matrix multiplication performance in CUDA.

This blog came from a sudden realisation of how little I knew about how matrix multiplication works on the GPU. Having done so many ML projects, I feel like I ought to understand how the most important operation in ML works: What is this “Tensor Core” thing? Why does everyone say “ …

art blog cuda dalle efficiency gpu hardware inspiration matrix matrix multiplication ml projects performance projects state