April 15, 2023, 3:07 p.m. | /u/macORnvidia

Data Science www.reddit.com

Accessing a sql server, using pyodbc, trying to get sql tables which I would like to merge into one csv/parquet or anything like that.

Pandas is too slow when using the pd.read_sql
; what's my other alternative that I can use to ingest the table? Dask? Duckdb? Something directly from the pyodbc?

big csv dask datascience duckdb merge pandas parquet python server sql table tables

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Lead Data Modeler

@ Sherwin-Williams | Cleveland, OH, United States