Deep Learning Training on Multi-Instance GPUs. (arXiv:2209.06018v1 [cs.LG])

Deep learning training is an expensive process that extensively uses GPUs,
but not all model training saturates the modern powerful GPUs. Multi-Instance
GPU (MIG) is a new technology introduced by NVIDIA that can partition a GPU to
better fit workloads that don't require all the memory and compute resources of
a full GPU. In this paper, we examine the performance of a MIG-enabled A100 GPU
under deep learning workloads of three sizes focusing on image recognition
training with ResNet models. …

arxiv deep learning deep learning training gpus training