How to Reduce the Training Time of Your Neural Network from Hours to Minutes

Part 2 of the articles on AI with HPC: parallelising a CNN with Horovod and GPUs to obtain a 75x-150x speed-up.

In part 1 of the series we looked at how it is possible to get a ~1500x speed-up in IO operations with a few lines of Python using the multiprocessing module. In this article, we will look at parallelising a deep learning code and reducing the training time from roughly 13 hours to …

deep-dives deep learning gpu network neural network neural networks parallel-computing reduce time training