Discontinuity in CNN Training Time with Increase Batch Size

Credit from: Xin Zhang & Yuqi Li @ Aipaca Inc.

Background

Model training time analysis is one of the important topics nowadays with the larger size of new machine learning models. Aside from those supergiant models like GPTs, computer vision models are slow to train for regular end users like data scientists and researchers. A computer vision model’s training time could range from a couple hours to a couple weeks depending on the task …

cloud cnn discontinuity machine learning open source research time training