all AI news
Queryable Logging with Blacklite
Aug. 21, 2023, 6:13 p.m. |
Simon Willison's Weblog simonwillison.net
Queryable Logging with Blacklite
Will Sargent describes how he built Blacklite, a Java library for diagnostic logging that writes log events (as zstd compressed JSON objects) to a SQLite database and maintains 5,000 entries in a "live" database while entries beyond that range are cycled out to an archive.db file, which is cycled to archive.timestamp.db when it reaches 500,000 items.
Lots of interesting notes here on using SQLite for high performance logging.
"SQLite databases are also better log files in …
beyond database diagnostic events java json library logging objects sqlite
More from simonwillison.net / Simon Willison's Weblog
Fast groq-hosted LLMs vs browser jank
1 day, 6 hours ago |
simonwillison.net
AI counter app from my PyCon US keynote
2 days, 4 hours ago |
simonwillison.net
Understand errors and warnings better with Gemini
2 days, 22 hours ago |
simonwillison.net
Jobs in AI, ML, Big Data
Software Engineer for AI Training Data (School Specific)
@ G2i Inc | Remote
Software Engineer for AI Training Data (Python)
@ G2i Inc | Remote
Software Engineer for AI Training Data (Tier 2)
@ G2i Inc | Remote
Data Engineer
@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania
Artificial Intelligence – Bioinformatic Expert
@ University of Texas Medical Branch | Galveston, TX
Lead Developer (AI)
@ Cere Network | San Francisco, US