File Formats Any Data Scientist Cares About

Efficient data import and representation is a key to any data science project dealing with large datasets. This talk will discuss import and export of Parquet, Arrow IPC and CSV files. These formats are part of the project aiming to add columnar data structures to Wolfram Language. A performance comparison with Python libraries will be presented.

arrow comparison csv data data science data scientist datasets discuss export file files import key language large datasets libraries parquet part performance project python representation science talk will wolfram