June 2, 2022, 10 a.m. | Ben Wilson, Michael Berk

Adventures in Machine Learning redcircle.com


MLlib is Apache Spark's scalable machine learning library. Today, Ben and Michael discuss the ease of use, performance, algorithms, and utilities included in this library and how to execute the best ML workflow with MLlib.



In this episode...



  1. Why stick with Spark libraries vs. a single node operation?

  2. What algorithms are not in Spark Lib?

  3. What is the min. package set to use for supervised learning?

  4. Modeling and validation

  5. Down-sampling your data

  6. MLlib vs. scikit-learn

  7. Resources



Sponsors


algorithms apache apache spark discuss libraries library machine machine learning mllib node performance scalable spark utilities workflow

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Data Engineer - Takealot Group (Takealot.com | Superbalist.com | Mr D Food)

@ takealot.com | Cape Town