AI/dify
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/langgenius/dify.git synced 2025-08-15 22:45:56 +08:00
Code Issues Packages Projects Releases Wiki Activity

fix text split (#15426)

Browse Source
This commit is contained in:
Jyong 2025-03-11 00:24:27 +08:00 committed by GitHub
parent adda049265
commit f77f7e1437
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
api/core/rag/splitter/fixed_text_splitter.py
View File

@ -88,7 +88,10 @@ class FixedRecursiveCharacterTextSplitter(EnhanceRecursiveCharacterTextSplitter)
break break
# Now that we have the separator, split the text # Now that we have the separator, split the text
if separator: if separator:
splits = text.split(separator) if separator == " ":
splits = text.split()
else:
splits = text.split(separator)
else: else:
splits = list(text) splits = list(text)
# Now go merging things, recursively splitting longer texts. # Now go merging things, recursively splitting longer texts.