June 6, 2022, 2:45 p.m. | /u/Evolving_Richie

Data Science www.reddit.com

Hi all,

Pretty much the title; if I have a good amount of data (say, 3 million rows, 10 cols). Parquet will on average have smaller file size and as such be faster to read into R or python or whatever. What situations would I prefer csv?

The ones I can think of are:

\- I occasionally want to open in excel (but opening a file this big risks crashing my computer)
\- I work with someone who prefers CSV …

csv datascience datasets large datasets parquet

Senior Machine Learning Engineer

@ GPTZero | Toronto, Canada

ML/AI Engineer / NLP Expert - Custom LLM Development (x/f/m)

@ HelloBetter | Remote

Doctoral Researcher (m/f/div) in Automated Processing of Bioimages

@ Leibniz Institute for Natural Product Research and Infection Biology (Leibniz-HKI) | Jena

Seeking Developers and Engineers for AI T-Shirt Generator Project

@ Chevon Hicks | Remote

Senior Applied Data Scientist

@ dunnhumby | London

Principal Data Architect - Azure & Big Data

@ MGM Resorts International | Home Office - US, NV