Sept. 29, 2023, 7:47 p.m. | /u/YoYoMaDiet

Data Science www.reddit.com

Serious question. At my work we’ve migrated almost all of our spark data engineering and ML pipelines to BigQuery, and it was really simple. With the added overhead of cluster management, and near feature parity, what’s the point of leveraging Spark anymore other than it being open source?

bigquery cluster data data engineering datascience engineering everything feature management ml pipelines near pipelines simple snowflake spark work

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

Lead Developer (AI)

@ Cere Network | San Francisco, US