Isn't storage a bottleneck for cloud computing?

I am interested in knowing if we want to use cloud GPUs for training and our data resides on AWS or GC, but we rent GPUs from another company, how would this affect our training performance? Does storage play a role like a bottleneck in this scenario?

​

aws cloud cloud computing computing data deeplearning gpus isn performance rent role storage training