Rise of Spark for Big Data Science

Apache Spark has become the go to solution when dealing with big data. Lets have a look at three reasons behind the popularity of Spark.

As the amount of data available for processing and analytics increased we saw a slow but definite shift to distributed systems (check out my article on rise of distributed systems, specifically Hadoop here). However, data science and machine learning for ‘big data’, as of early 2000s, still proved challenging. The then cutting edge solutions …

apache spark big big data data data science machine learning science spark