Smart Distributed Training on Amazon SageMaker with SMD: Part 1

How Choosing a Distribution Algorithm that is Aligned with the Capabilities of your Training Instances can Increase Throughput and Reduce Cost

A critical step in optimizing the runtime performance of your training jobs is tuning your algorithms so as to maximize the utilization of the resources in your training environment. This requires a thorough understanding of your resources, (the number and types of computation devices, the available memory, communication bandwidths, etc.) as well as …

amazon amazon sagemaker deep learning distributed distributed-training machine learning optimization part sagemaker smart training