[D] How to divide a chunk for RAG

Hello guys,

I need some advice, assume that you are building a RAG. You want your context chunks to be 512 token long. How to divide a solid 1000+ paragraph without loosing semantic connection.

For more information,
Its an question answering bot, that huge paragraph is answer to one of a frequently asked question.

advice bot building context hello information machinelearning question question answering rag semantic solid token