Jan. 1, 2022, 4:31 p.m. | Georgia Deaconu

Towards Data Science - Medium towardsdatascience.com

3 ways to deal with large datasets in Python

As a data scientist, I find myself more and more having to deal with “big data”. What I abusively call big data corresponds to datasets that, while not really that large, are large enough to make my computer struggle to process them and really slow everything down.

Photo by Mika Baumeister on Unsplash

This problem is not new and as with everything, there is no one size fits it …

big data data analysis data science datasets deal machine learning programming python

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Enterprise AI Architect

@ Oracle | Broomfield, CO, United States

Cloud Data Engineer France H/F (CDI - Confirmé)

@ Talan | Nantes, France