[D] A brief note about GPU power consumption and clock speeds

I just built myself a new machine with an RTX 3090, and have been training some models.

When I place no limits on the GPU, it consumes ~350 watts, averages ~80% utilization, and completes an epoch for the model and dataset I'm using in 50 seconds.

When I limit the GPU to 1500 MHz, it consumes ~220 watts, averages ~90% utilization, and completes an epoch for the same model and the same dataset in 54 seconds. So I save more …

clock speeds gpu machinelearning power power consumption