Looking to build a $200K GPU server to serve API requests for Stable Diffusion, Segment Anything and TTS models. What's my best option? [D]

Theoretically we'll be serving a large number of users and I am worried about clogging entire GPUs for example on a Stable Diffusion request that would take Nvidia A100 about 20 seconds to fulfill.

Do I need as many GPUs as my concurrent users?

Is there any relevant guide on GPU virtualizations?

a100 api diffusion example gpu gpus machinelearning nvidia nvidia a100 serve server stable diffusion tts