all AI news
The 5 Levels Of Text Splitting For Retrieval
Jan. 8, 2024, 1:30 p.m. | Greg Kamradt (Data Indy)
Data Independent www.youtube.com
Get updates from me: https://mail.gregkamradt.com/
* https://www.chunkviz.com/
Greg’s Info:
- Twitter: https://twitter.com/GregKamradt
- Newsletter: https://mail.gregkamradt.com/
- Website: https://gregkamradt.com/
- LinkedIn: https://www.linkedin.com/in/gregkamradt/
- Work with me: https://tiny.one/TEi2HhN
- Contact Me: Twitter DM, LinkedIn Message, or contact@dataindependent.com
Outline:
0:00 - Intro
3:42 - Theory
6:57 - Level 1: Character Split
16:04 - Level 2: Recursive Character Split
20:59 - Level 3: Document Specific Splitting
32:10 - Level 4: Semantic Splitting (With Embeddings)
48:02 - Level 5: Agentic Splitting
1:02:47 …
bonus document embeddings greg intro linkedin recursive representation semantic theory twitter
More from www.youtube.com / Data Independent
I didn't know RAG could be this easy
2 weeks, 6 days ago |
www.youtube.com
The fastest talking AI I could build (Deepgram + Groq)
1 month, 2 weeks ago |
www.youtube.com
I just found my new favorite AI industry (Big Opportunity)
2 months, 1 week ago |
www.youtube.com
The 5 Levels Of Text Splitting For Retrieval
3 months, 3 weeks ago |
www.youtube.com
I pressure tested GPT-4's 128K context retrieval
5 months, 2 weeks ago |
www.youtube.com
FullStackRetrieval.com - All Things LLM Retrieval
5 months, 2 weeks ago |
www.youtube.com
Jobs in AI, ML, Big Data
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
AI Engineering Manager
@ M47 Labs | Barcelona, Catalunya [Cataluña], Spain