AI/ragflow
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/infiniflow/ragflow.git synced 2025-08-14 01:15:51 +08:00
Code Issues Packages Projects Releases Wiki Activity

Fix: delimiter issue. (#5720)

Browse Source 
### What problem does this PR solve?

#5704

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
This commit is contained in:
Kevin Hu 2025-03-06 17:51:22 +08:00 committed by GitHub
parent ff35c140dc
commit 8fb8374dfc
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
deepdoc/parser/txt_parser.py
View File

@ -31,6 +31,7 @@ class RAGFlowTxtParser:
raise TypeError("txt type should be str!") raise TypeError("txt type should be str!")
cks = [""] cks = [""]
tk_nums = [0] tk_nums = [0]
delimiter = delimiter.encode('utf-8').decode('unicode_escape').encode('latin1').decode('utf-8')
def add_chunk(t): def add_chunk(t):
nonlocal cks, tk_nums, delimiter nonlocal cks, tk_nums, delimiter