all AI news
stanchion
Jan. 31, 2024, 10:32 p.m. |
Simon Willison's Weblog simonwillison.net
Dan Gallagher's new (under-development) SQLite extension that adds column-oriented tables to SQLite, using a virtual table implemented in Zig that stores records in row groups, where each row group has multiple segments (one for each column) and those segments are stored as SQLite BLOBs.
I'm surprised that this is possible using the virtual table mechanism. It has the potential to bring some of the analytical querying performance we've seen in engines like DuckDB to SQLite itself.
Via Alex Garcia
column dan development extension multiple records sqlite table tables virtual
More from simonwillison.net / Simon Willison's Weblog
Jobs in AI, ML, Big Data
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Data Analyst (Digital Business Analyst)
@ Activate Interactive Pte Ltd | Singapore, Central Singapore, Singapore