April 22, 2024, 7 a.m. | Rafal Gancarz

InfoQ - AI, ML & Data Engineering www.infoq.com

Yelp reworked its data streaming architecture by employing Apache Beam and Apache Flink. The company replaced a fragmented set of data pipelines for streaming transactional data into its analytical systems, like Amazon Redshift and in-house data lake, using Apache data streaming projects to create a unified and flexible solution.

By Rafal Gancarz

ai amazon amazon redshift apache apache-beam apache flink apache kafka architecture architecture & design create data data lake data pipelines data streaming event stream processing flink lake ml & data engineering pipelines projects redshift set solution streaming systems the company yelp

More from www.infoq.com / InfoQ - AI, ML & Data Engineering

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Lead Data Modeler

@ Sherwin-Williams | Cleveland, OH, United States