Empowering Data Mesh with Federated Learning

arXiv:2403.17878v1 Announce Type: new
Abstract: The evolution of data architecture has seen the rise of data lakes, aiming to solve the bottlenecks of data management and promote intelligent decision-making. However, this centralized architecture is limited by the proliferation of data sources and the growing demand for timely analysis and processing. A new data paradigm, Data Mesh, is proposed to overcome these challenges. Data Mesh treats domains as a first-class concern by distributing the data ownership from the central team to …

abstract analysis architecture arxiv bottlenecks cs.dc cs.lg data data architecture data lakes data management data mesh data sources decision demand evolution federated learning however intelligent making management mesh paradigm processing promote solve type