all AI news
Fastest Way to Read Excel in Python
Jan. 3, 2024, 8:04 p.m. |
Simon Willison's Weblog simonwillison.net
Fastest Way to Read Excel in Python
Haki Benita produced a meticulously researched and written exploration of the options for reading a large Excel spreadsheet into Python. He explored Pandas, Tablib, Openpyxl, shelling out to LibreOffice, DuckDB and python-calamine (a Python wrapper of a Rust library). Calamine was the winner, taking 3.58s to read 500,00 rows - compared to Pandas in last place at 32.98s.
Via lobste.rs
duckdb excel exploration library pandas python reading rust spreadsheet wrapper
More from simonwillison.net / Simon Willison's Weblog
How an empty S3 bucket can make your AWS bill explode
1 day, 16 hours ago |
simonwillison.net
My approach to HTML web components
1 day, 17 hours ago |
simonwillison.net
Jobs in AI, ML, Big Data
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Sr. VBI Developer II
@ Atos | Texas, US, 75093
Wealth Management - Data Analytics Intern/Co-op Fall 2024
@ Scotiabank | Toronto, ON, CA