all AI news
Design concept of a best opensource project about big data and data lakehouse
April 16, 2022, 3:54 p.m. | qazmkop
DEV Community dev.to
Since the birth of Hadoop, the open-source ecosystem of big data systems has gone through nearly 15 years. In the past 15 years, various computing and storage frameworks have emerged in big data, but they still haven't reached a convergence state. Under the general trend of cloud-native, stream and batch integration, lake and lakehouse integration, there are still many problems to be solved in big data.
LakeSoul is a streaming batch integrated table storage framework developed by DMetaSoul, which has …
big big data bigdata data dataengineering data lakehouse datascience design lakehouse opensource project
More from dev.to / DEV Community
Jobs in AI, ML, Big Data
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Lead Data Modeler
@ Sherwin-Williams | Cleveland, OH, United States