all AI news
Queryable Logging with Blacklite
Aug. 21, 2023, 6:13 p.m. |
Simon Willison's Weblog simonwillison.net
Queryable Logging with Blacklite
Will Sargent describes how he built Blacklite, a Java library for diagnostic logging that writes log events (as zstd compressed JSON objects) to a SQLite database and maintains 5,000 entries in a "live" database while entries beyond that range are cycled out to an archive.db file, which is cycled to archive.timestamp.db when it reaches 500,000 items.
Lots of interesting notes here on using SQLite for high performance logging.
"SQLite databases are also better log files in …
beyond database diagnostic events java json library logging objects sqlite
More from simonwillison.net / Simon Willison's Weblog
I'm writing a new vector search SQLite Extension
2 days, 1 hour ago |
simonwillison.net
Printing music with CSS Grid
2 days, 14 hours ago |
simonwillison.net
We can have a different web
3 days, 2 hours ago |
simonwillison.net
Jobs in AI, ML, Big Data
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne