all AI news
Automate Your Pipeline Creation For Streaming Data Transformations With SQLake
Data Engineering Podcast www.dataengineeringpodcast.com
Summary
Managing end-to-end data flows becomes complex and unwieldy as the scale of data and its variety of applications in an organization grows. Part of this complexity is due to the transformation and orchestration of data living in disparate systems. The team at Upsolver is taking aim at this problem with the latest iteration of their platform in the form of SQLake. In this episode Ori Rafael explains how they are automating the creation and scheduling of orchestration flows and …
aim announcements applications automate complexity data data lake iteration orchestration part pipeline platform scale scheduling sql streaming streaming data summary systems team transformation