all AI news
Data pipeline - alternatives to database table reinsertion for large, post-processed dataset
Jan. 8, 2022, 1:28 a.m. | /u/bigchungusmode96
Data Science www.reddit.com
I have a dataset of millions of transactions that I am pulling from multiple data tables. I handle the data query, merge, cleaning & processing in Python when I run a ML script.
Now I also need a way to have the processed data accessible for a BI dashboard. The direct way I can think of is inserting the data back into a data table, but I'm wondering if there are better ways to do this?
- I'm not sure whether …
More from www.reddit.com / Data Science
What is a Lead Junior Data Analyst?
1 day, 1 hour ago |
www.reddit.com
Top Cities in the US for Data Scientists in terms of Salary vs Cost of …
1 day, 5 hours ago |
www.reddit.com
Thinking of dipping out of DS for an MBA. Legit looking for advice.
1 day, 10 hours ago |
www.reddit.com
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Director, Global Procurement Data Analytics
@ Alcon | Fort Worth - Main
Backend Software Engineer, Airbnb for Real Estate
@ Airbnb | United States
Data Scientist
@ Exoticca | Barcelona, Catalonia, Spain - Remote
ESG Data Analytics Summer Associate (Intern)
@ Apex Clean Energy | Charlottesville, VA, United States
Team Lead, Machine Learning
@ Prenuvo | Vancouver, British Columbia, Canada