What to use parquet or CSV?

History of Parquet File: A Big Data Storage Revolution

The Parquet file format has emerged as a dominant force in the realm of big data storage and analytics. Here's a glimpse into its fascinating journey:

Origins (Pre-2013)

The groundwork for Parquet can be traced back to Apache Trevni, a columnar storage format created by Doug Cutting, the visionary behind Hadoop. Trevni laid the foundation for efficient data storage and retrieval, paving the way for future advancements.

Birth of Parquet …

analytics apache big big data bigdata big data storage csv data database datascience data storage file format history journey parquet python realm storage