[Discussion] Seeking help to find the better GPU setup. Three H100 vs Five A100?

Long story short, a company has a budget for buying GPUs expected to fine-tune LLMs(probably 70B ones), and I have to the research to find which GPU setup is the best with respect to their budget.

The budget can buy **three H100** GPUs or **five A100** GPUs.

I tried my best but until now is not clear to me which of these setups is better. While five A100s have more VRAM, they say H100 are 2-8 times faster than A100s! …

70b a100 budget five gpu gpus h100 llms machinelearning ones research setup story