all AI news
ChunkViz
Feb. 2, 2024, 2:23 a.m. |
Simon Willison's Weblog simonwillison.net
Handy tool by Greg Kamradt to help understand how different text chunking mechanisms work by visualizing them. Chunking is an important part of preparing text to be embedded for semantic search, and thanks to this tool I've finally got a solid mental model of what recursive character text splitting does.
ai embedded embeddings greg part recursive search semantic solid text them tool via work
More from simonwillison.net / Simon Willison's Weblog
uv pip install --exclude-newer example
1 day, 15 hours ago |
simonwillison.net
Quoting Nathaniel Borenstein
3 days, 11 hours ago |
simonwillison.net
Slop is the new name for unwanted AI-generated content
3 days, 13 hours ago |
simonwillison.net
OpenAI Model Spec, May 2024 edition
3 days, 13 hours ago |
simonwillison.net
Jobs in AI, ML, Big Data
Data Engineer
@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania
Artificial Intelligence – Bioinformatic Expert
@ University of Texas Medical Branch | Galveston, TX
Lead Developer (AI)
@ Cere Network | San Francisco, US
Research Engineer
@ Allora Labs | Remote
Ecosystem Manager
@ Allora Labs | Remote
Founding AI Engineer, Agents
@ Occam AI | New York