Jan. 25, 2024, 2:39 p.m. | /u/chris_813

Data Science www.reddit.com

I read an article in medium (yeah, I know this is starting bad) about data visualization for Large Data that went from using pyspark on the data warehouse to a plotly-dash dashboard, with a pretty sneaky toPandas transformation on the middle. This step was which I thought it was actually killing the idea of visualization on big data, but it is actually practical? Or everyone just filter the data to get a light representation?

article big big data dash dashboard data datascience data visualization data warehouse medium near plotly pyspark real-time thought transformation visualization warehouse

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Lead Data Modeler

@ Sherwin-Williams | Cleveland, OH, United States