Kevin Hu
0758c04941
Refa: token similarity calculations. ( #6614 )
...
### What problem does this PR solve?
#6507
### Type of change
- [x] Performance Improvement
2025-03-28 09:33:08 +08:00
Kevin Hu
15736c57c3
Fix: empty query issue. ( #5830 )
...
### What problem does this PR solve?
#5214
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-03-10 13:56:56 +08:00
Kevin Hu
4f40f685d9
Code refactor ( #5371 )
...
### What problem does this PR solve?
#5173
### Type of change
- [x] Refactoring
2025-02-26 15:40:52 +08:00
Kevin Hu
53b9e7b52f
Add tavily as web searh tool. ( #5349 )
...
### What problem does this PR solve?
#5198
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-02-26 10:21:04 +08:00
Kevin Hu
cdb3e6434a
Fix empty question issue. ( #5225 )
...
### What problem does this PR solve?
#5241
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-21 15:47:39 +08:00
Kevin Hu
6f2c3a3c3c
Fix too long query exception. ( #4729 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-06 10:11:52 +08:00
Kevin Hu
c5da3cdd97
Tagging ( #4426 )
...
### What problem does this PR solve?
#4367
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-01-09 17:07:21 +08:00
Kevin Hu
f948c0d9f1
Clean query. ( #4259 )
...
### What problem does this PR solve?
#4239
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-12-27 14:25:03 +08:00
Kevin Hu
927873bfa6
Fix syn error. ( #3953 )
...
### What problem does this PR solve?
Close #3696
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-12-10 10:54:54 +08:00
Zhichang Yu
0d68a6cd1b
Fix errors detected by Ruff ( #3918 )
...
### What problem does this PR solve?
Fix errors detected by Ruff
### Type of change
- [x] Refactoring
2024-12-08 14:21:12 +08:00
Kevin Hu
56f473b680
Feat: Add question parameter to edit chunk modal ( #3875 )
...
### What problem does this PR solve?
Close #3873
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-12-05 14:51:19 +08:00
Kevin Hu
1b817a5b4c
Refine synonym query. ( #3855 )
...
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
2024-12-04 17:20:12 +08:00
Zhichang Yu
bc701d7b4c
Edit chunk shall update instead of insert it ( #3709 )
...
### What problem does this PR solve?
Edit chunk shall update instead of insert it. Close #3679
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-28 13:00:38 +08:00
Kevin Hu
57208d8e53
Fix batch size issue. ( #3675 )
...
### What problem does this PR solve?
#3657
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-27 18:06:43 +08:00
Kevin Hu
ca9e97d2f2
Enlarge the term weight difference ( #3435 )
...
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
2024-11-15 15:41:50 +08:00
Kevin Hu
48e060aa53
rm es query escape chars ( #3428 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-15 13:19:07 +08:00
Kevin Hu
a1ba228bc2
fix: empty token bug ( #3424 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-15 10:33:03 +08:00
Kevin Hu
220aaddc62
fix: synonym bug ( #3423 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-11-15 10:14:51 +08:00
Zhichang Yu
30f6421760
Use consistent log file names, introduced initLogger ( #3403 )
...
### What problem does this PR solve?
Use consistent log file names, introduced initLogger
### Type of change
- [ ] Bug Fix (non-breaking change which fixes an issue)
- [ ] New Feature (non-breaking change which adds functionality)
- [ ] Documentation Update
- [x] Refactoring
- [ ] Performance Improvement
- [ ] Other (please describe):
2024-11-14 17:13:48 +08:00
Kevin Hu
91332fa0f8
Refine english synonym ( #3371 )
...
### What problem does this PR solve?
#3361
### Type of change
- [x] Performance Improvement
2024-11-13 12:58:37 +08:00
Zhichang Yu
f4c52371ab
Integration with Infinity ( #2894 )
...
### What problem does this PR solve?
Integration with Infinity
- Replaced ELASTICSEARCH with dataStoreConn
- Renamed deleteByQuery with delete
- Renamed bulk to upsertBulk
- getHighlight, getAggregation
- Fix KGSearch.search
- Moved Dealer.sql_retrieval to es_conn.py
### Type of change
- [x] Refactoring
2024-11-12 14:59:41 +08:00
Kevin Hu
d88f0d43ea
make language judgement robuster ( #3287 )
...
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
2024-11-08 12:48:11 +08:00
Kevin Hu
55953819c1
accelerate term weight calculation ( #3206 )
...
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
2024-11-05 13:11:26 +08:00
Kevin Hu
b164116277
refine token similarity ( #2824 )
...
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
2024-10-14 13:33:18 +08:00
Kevin Hu
54342ae0a2
boost highlight performace ( #2419 )
...
### What problem does this PR solve?
#2415
### Type of change
- [x] Performance Improvement
2024-09-13 18:10:32 +08:00
Kevin Hu
5a2c542ce2
make term similarity robust ( #2212 )
...
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
2024-09-03 14:30:07 +08:00
Kevin Hu
6d232f1bdb
enable 3 char words to finegrind tokenize ( #2210 )
...
### What problem does this PR solve?
### Type of change
- [x] Performance Improvement
2024-09-03 13:37:32 +08:00
Kevin Hu
642006c8e2
filter out + in es query ( #2046 )
...
### What problem does this PR solve?
#2028
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
- [ ]
2024-08-22 10:02:04 +08:00
KevinHuSh
e35f7610e7
fix too long query exception ( #1195 )
...
### What problem does this PR solve?
#1161
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-06-18 09:50:59 +08:00
KevinHuSh
4454ba7a1e
add self-rag ( #1070 )
...
### What problem does this PR solve?
#1069
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-06-06 11:13:39 +08:00
Jin Hai
9ed0e50f6b
Update info ( #1005 )
...
### What problem does this PR solve?
_Briefly describe what this PR aims to solve. Include background context
that will help reviewers understand the purpose of the PR._
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2024-05-31 09:53:04 +08:00
KevinHuSh
758eb03ccb
fix jina adding issure and term weight refinement ( #974 )
...
### What problem does this PR solve?
#724 #162
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] New Feature (non-breaking change which adds functionality)
2024-05-29 19:38:57 +08:00
KevinHuSh
614defec21
add rerank model ( #969 )
...
### What problem does this PR solve?
feat: add rerank models to the project #724 #162
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-29 16:50:02 +08:00
KevinHuSh
2b36283712
fix english query bug ( #840 )
...
### What problem does this PR solve?
#834
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-20 12:23:51 +08:00
Fakai Zhao
de839fc3f0
optimize srv broker and executor logic ( #630 )
...
### What problem does this PR solve?
Optimize task broker and executor for reduce memory usage and deployment
complexity.
### Type of change
- [x] Performance Improvement
- [x] Refactoring
### Change Log
- Enhance redis utils for message queue(use stream)
- Modify task broker logic via message queue (1.get parse event from
message queue 2.use ThreadPoolExecutor async executor )
- Modify the table column name of document and task (process_duation ->
process_duration maybe just a spelling mistake)
- Reformat some code style(just what i see)
- Add requirement_dev.txt for developer
- Add redis container on docker compose
---------
Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
2024-05-07 11:43:33 +08:00
KevinHuSh
8c07992b6c
refine code ( #595 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-04-28 19:13:33 +08:00
KevinHuSh
923cbe488e
fix #258 task_executor occupy cpu too much ( #288 )
...
### What problem does this PR solve?
Issue link:#285
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-04-10 10:11:22 +08:00
KevinHuSh
653c759d8d
resolve issure to call ZH?IPUAI ( #277 )
...
### What problem does this PR solve?
Issue link:#265
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-04-09 16:16:10 +08:00
KevinHuSh
392e515c3f
fix bug about reload knowledgebase configuration reloading ( #210 )
...
### What problem does this PR solve?
_Briefly describe what this PR aims to solve. Include background context
that will help reviewers understand the purpose of the PR._
Issue link:#[[Link the issue
here](https://github.com/infiniflow/ragflow/issues/209 )]
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-04-03 11:00:50 +08:00
KevinHuSh
05298d5626
refine README ( #169 )
2024-03-29 10:48:29 +08:00
KevinHuSh
fd7fcb5baf
apply pep8 formalize ( #155 )
2024-03-27 11:33:46 +08:00
KevinHuSh
da21320b88
fix plainPdf bugs ( #152 )
2024-03-26 15:11:07 +08:00
KevinHuSh
6999598101
refine for English corpus ( #135 )
2024-03-20 16:56:16 +08:00
KevinHuSh
9a843667b3
fix github account login issue ( #132 )
2024-03-19 15:31:47 +08:00
KevinHuSh
9da671b951
refine manul parser ( #131 )
2024-03-19 12:26:04 +08:00
KevinHuSh
b89ac3c4be
chage tas execution logic ( #103 )
2024-03-06 19:16:31 +08:00
KevinHuSh
484e5abc1f
llm configuation refine and trievalTest API refine ( #40 )
2024-01-19 19:51:57 +08:00
KevinHuSh
9bf75d4511
add dialog api ( #33 )
2024-01-17 20:20:42 +08:00
KevinHuSh
30791976d5
build python version rag-flow ( #21 )
...
* clean rust version project
* clean rust version project
* build python version rag-flow
2024-01-15 08:46:22 +08:00