Choosing a Data Lake Format: What to Actually Look For

Recently we’ve seen lots of posts about a variety of different file formats for data lakes. There’s Delta Lake, Hudi, Iceberg, and QBeast, to name a few.

It can be tough to keep track of all these data lake formats — let alone figure out why (or if!) we really need this wide of a selection, and more importantly, which data lake is best for a given use case.

The short answer: All those special data lake formats are …

artificial intelligence data data lake data lakes data science delta figure format iceberg lake look open-data open source