Best GPU tensor abstraction libraries with efficient compilation? (Triton, Halide, Tensor Comprehensions, TorchScript etc.) [D]

Obviously CUDA is available for low-level GPU programming, but takes a lot of time to program in. Then you have libraries like Pytorch that implement high-level operations, but can be extremely slow for trying to do complex things.

Then there's the interesting space of languages that try to slot in just above CUDA on the abstraction level - Triton and Halide.

Then there are the einstein-notation flavored livraries that are good for tensor reductions. Tensor Comprehensions is one that uses …

abstraction compilation cuda etc gpu languages libraries low machinelearning operations programming pytorch space tensor triton