Overview of Text Chunking methods for Retrieval-Augmented Generation (with Code!)

Hey everyone, we have a new tutorial on Weaviate YouTube going over 3 commonly used text chunking strategies, 1. Hard Splits, 2. Rolling Windows, and 3. Parsing by Headers!

I think Parsing by Headers is the most exciting strategy by far, especially because of it's ability to preserve semantic regions of a document. For example, if you look at this Reddit page it would make sense to separate the text in this post with the "Posting to Reddit" rules in …

code deeplearning hey overview parsing retrieval semantic strategies strategy text think tutorial weaviate windows youtube