Scala Without Spark?

I just joined a team that has their entire modeling suite in scala and spark and they leverage the dataframe API. For some of our data that makes sense we have data in the hundreds of terrabytes, but for other data we're actually in the megabytes, and things that should take a second are taking 20 minutes sometimes, mostly due to all the spark jobs that are created.



To my management this isn't a big deal none of this stuff …

datascience scala spark