Great question — answering as the UphillTech team:
I found that RecursiveCharacterTextSplitter will not overlap chunks that are split by a separator, like how you have it: separators=["\n\n", "\n", "(?<=\. )", " ", ""] What's happening is that each of your two paragraphs is being made into its own whole chunk due to the \n\n separator. Thus these chunks are considered separate and will not generate overlap. If you had a paragraph that was greater than your 350 chunk size (or if your chunk size was smaller), the paragraph would get split into multiple chunks, and those chunks would have overlap. I assume the package's logic is that, since you are purposefully semantically separating those paragraphs, you wouldn't want them to have their...
Full answer by MikeBikeLA: https://stackoverflow.stackexchange.com/a/76918209 (CC BY-SA 4.0).
Need it done for your business? UphillTech.
