[D] PyTorch processes taking up tons of GPU memory - any way to reduce this?

I am running on Arch Linux 5.17.9-arch1-1 with an NVIDIA GeForce RTX 3090 GPU.
I need to run multiple processes for a reinforcement learning task, where each subprocess runs the data collection (and inference) and all the samples from that are then retrieved via queues in the main process and optimized (e.g. think of PPO but distributed, like IMPALA). I am using `torch.multiprocessing` for this.

Unfortunately, the multiple spawned subprocesses cause A LOT of overhead in terms of GPU memory …

gpu machinelearning memory processes pytorch reduce