Profiling and Improving the PyTorch Dataloader for high-latency Storage: A Technical Report. (arXiv:2211.04908v1 [cs.LG])

A growing number of Machine Learning Frameworks recently made Deep Learning
accessible to a wider audience of engineers, scientists, and practitioners, by
allowing straightforward use of complex neural network architectures and
algorithms. However, since deep learning is rapidly evolving, not only through
theoretical advancements but also with respect to hardware and software
engineering, ML frameworks often lose backward compatibility and introduce
technical debt that can lead to bottlenecks and sub-optimal resource
utilization. Moreover, the focus is in most cases not …

arxiv dataloader latency profiling pytorch report storage technical