Faster DataFrame Serialization

Read and write dataframes op to ten times faster than Parquet with StaticFrame NPZ

The Apache Parquet format provides an efficient binary representation of columnar table data, as seen with widespread use in Apache Hadoop and Spark, AWS Athena and Glue, and Pandas DataFrame serialization. While Parquet offers broad interoperability with performance superior to text formats (such as CSV or JSON), it is as much as ten times slower than NPZ, an alternative DataFrame serialization format introduced …

dataframes numpy pandas parquet serialization