[D] NVIDIA GPU Benchmarks & Comparison

[https://tensordock.com/benchmarks](https://tensordock.com/benchmarks)

Spent the past few hours putting together some data on vLLM (for both Llama 7B and OPT-125M) and Resnet-50 training performance on the TensorDock cloud.

vLLM data is 100% out of the box, with 2048 batch sizes from [this repository](https://github.com/vllm-project/vllm/tree/main/benchmarks).

My learnings:

* H100 and A100 performance is unbeatable, but the price-to-performance of lower-end RTX cards is pretty darn good. Even the L40 and RTX 6000 Ada outperform the A100 at some tasks, as they are 1 generation newer …

a100 ada cards cloud data good h100 llama machinelearning opt-125m performance price resnet resnet-50 rtx rtx 6000 tasks together training