PyTorch Model Performance Analysis and Optimization — Part 3

PyTorch Model Performance Analysis and Optimization — Part 3

How to reduce “Cuda Memcpy Async” events and why you should beware of boolean mask operations

This is the third part of a series of posts on the topic of analyzing and optimizing PyTorch models using PyTorch Profiler and TensorBoard. Our intention has been to highlight the benefits of performance profiling and optimization of GPU-based training workloads and their potential impact on the speed …

analysis artificial intelligence async cuda deep learning events optimization part performance performance analysis pytorch reduce series tensorboard