3x25: The Unique Challenges of ML Training Data with Bin Fan

Machine learning is unlike any other enterprise application, demanding massive datasets  from distributed sources. In this episode, Bin Fan of Alluxio discusses the unique challenges of distributed heterogeneous data to support ML workloads with Frederic Van Haren and Stephen Foskett. The systems supporting AI training are unique, with GPUs and other AI accelerators distributed across multiple machines, each accessing the same massive set of small files. Conventional storage solutions are not equipped to serve parallel access to such a large …

challenges data ml training training data