March 9, 2022, 1:38 p.m. | Angelica Lo Duca

Towards Data Science - Medium towardsdatascience.com

Data Preprocessing

A tutorial on how to use the to_csv_folder() and to_parquet_folder() methods provided by Terality

Photo by NASA on Unsplash

Recently, I have read an interesting article by Bex T., who illustrated Terality, a Python package, which provides the same methods as the well-known Pandas, with the possibility to also manipulate huge datasets, up to terabytes of data.

Since I also found myself having to manipulate large datasets, I decided to test the Terality library. From …

artificial intelligence data pandas python women-in-tech

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne