[D] How can I configure two GPUs to share their memory?

Hey,

I've been trying to build an ML workstation and was considering the idea of using two RTX 3090's to get the extra VRAM instead of a single 4090. However, I've come across some confusion regarding whether they can share their VRAM or not. Do I need to run them via NVLink to achieve this? I believe PyTorch's data parallelism splits the batches across both GPUs, but that wouldn't effectively combine their VRAM right?

Any advice or insights you can …

build extra gpus hey machinelearning memory rtx rtx 3090 workstation