zhuhao
dcb3fb2073
fix: use user-defined rerank model's top_k parameter when knowledge Q&A conversation ( #1396 )
...
### What problem does this PR solve?
During knowledge Q&A conversations, the user-defined rerank model's
top_k parameter was not used
#1395
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-07-08 09:25:49 +08:00
cecilia-uu
b5389f487c
API: created list_doc ( #1327 )
...
### What problem does this PR solve?
Adds the api of listing documentation.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-07-01 18:15:00 +08:00
KevinHuSh
92e9320657
upgrade laws parser of docx ( #1332 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-07-01 15:50:24 +08:00
Wang Baoling
0b90aab22c
fix: using embd which user configured at knowledgebase ( #1163 )
...
### What problem does this PR solve?
as title
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-06-19 14:44:25 +08:00
cecilia-uu
8d667d5abd
fixed: duplicate name ( #1202 )
...
### What problem does this PR solve?
Duplicate method name.
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-06-18 16:28:46 +08:00
cecilia-uu
1eb4caf02a
create list_dataset api and tests ( #1138 )
...
### What problem does this PR solve?
This PR have completed both HTTP API and Python SDK for 'list_dataset".
In addition, there are tests for it.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-06-17 12:19:05 +08:00
KevinHuSh
2023fdc13e
fix file preview in file management ( #1151 )
...
### What problem does this PR solve?
fix file preview in file management
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-06-14 10:33:59 +08:00
KevinHuSh
abcd3d2469
refactor ( #1124 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-06-12 11:02:15 +08:00
KevinHuSh
d9dc183a0e
rm wrongly uploaded py ( #1073 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-06-06 13:49:48 +08:00
KevinHuSh
4454ba7a1e
add self-rag ( #1070 )
...
### What problem does this PR solve?
#1069
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-06-06 11:13:39 +08:00
KevinHuSh
1de31ca9f6
refine file select code ( #1021 )
...
### What problem does this PR solve?
#1015
### Type of change
- [x] Refactoring
2024-05-31 19:44:33 +08:00
Zhedong Cen
4ec845c0a6
Add API for moving files ( #1016 )
...
### What problem does this PR solve?
Add backend API support for moving files into other directory
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-31 18:11:25 +08:00
KevinHuSh
5d2f7136dd
fix chunk modification bug ( #1011 )
...
### What problem does this PR solve?
As title.
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-31 15:45:11 +08:00
KevinHuSh
83803a72ee
fix ollama bug ( #999 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-30 18:03:36 +08:00
KevinHuSh
758eb03ccb
fix jina adding issure and term weight refinement ( #974 )
...
### What problem does this PR solve?
#724 #162
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] New Feature (non-breaking change which adds functionality)
2024-05-29 19:38:57 +08:00
KevinHuSh
614defec21
add rerank model ( #969 )
...
### What problem does this PR solve?
feat: add rerank models to the project #724 #162
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-29 16:50:02 +08:00
KevinHuSh
daa4799385
limit the system context length of conversation messages. ( #962 )
...
### What problem does this PR solve?
#951
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-29 10:40:07 +08:00
KevinHuSh
46454362d7
fix raptor bugs ( #928 )
...
### What problem does this PR solve?
#922
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-27 11:01:20 +08:00
KevinHuSh
6f99bbbb08
add raptor ( #899 )
...
### What problem does this PR solve?
#882
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-23 14:31:16 +08:00
GYH
be13429d05
Add api/list_kb_docs function and modify api/list_chunks ( #874 )
...
### What problem does this PR solve?
#717
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-22 14:58:56 +08:00
KevinHuSh
2b36283712
fix english query bug ( #840 )
...
### What problem does this PR solve?
#834
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-20 12:23:51 +08:00
KevinHuSh
673a28e492
fix bug of chat without stream ( #830 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-17 20:03:00 +08:00
KevinHuSh
b3c923da6b
add doc ids in API: completion ( #827 )
...
### What problem does this PR solve?
#808
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-17 17:51:54 +08:00
KevinHuSh
a1586e0af9
correct mismatched kb doc number ( #826 )
...
### What problem does this PR solve?
#620
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-17 17:27:39 +08:00
GYH
081f922ee6
0517 list chunks ( #821 )
...
### What problem does this PR solve?
#717
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-17 15:58:05 +08:00
KevinHuSh
a2a6a35e94
fix doc number miss-match issue ( #822 )
...
### What problem does this PR solve?
#620
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-17 15:35:09 +08:00
KevinHuSh
e73ce39b66
Add 2 embeding models from OpenAI ( #812 )
...
### What problem does this PR solve?
#810
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-17 08:51:29 +08:00
KevinHuSh
95f809187e
add stream chat ( #811 )
...
### What problem does this PR solve?
#709
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-16 20:14:53 +08:00
KevinHuSh
d6772f5dd7
add version ( #807 )
...
### What problem does this PR solve?
#709
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-16 16:17:48 +08:00
KevinHuSh
1c4e92ed35
Knowledge base search is case sensitive ( #797 )
...
### What problem does this PR solve?
#793
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-16 09:00:12 +08:00
KevinHuSh
d8c080ee52
fix bugs in searching file using keywords ( #780 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-15 12:51:57 +08:00
KevinHuSh
aa1c915d6e
support gpt-4o ( #773 )
...
### What problem does this PR solve?
#771
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-15 11:16:08 +08:00
KevinHuSh
04a9e95161
let file in knowledgebases visible in file manager ( #714 )
...
### What problem does this PR solve?
Let file in knowledgebases visible in file manager.
#162
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-05-11 16:04:28 +08:00
KevinHuSh
7ddb2f19be
make sure to raise exception if redis is not there ( #674 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-05-08 15:20:45 +08:00
KevinHuSh
8d6d7f6887
fix task losting isssue ( #665 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-07 20:46:45 +08:00
KevinHuSh
a5aed2412f
fix bugs ( #662 )
...
### What problem does this PR solve?
Fix import error for task_service.py
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-05-07 16:41:56 +08:00
Fakai Zhao
de839fc3f0
optimize srv broker and executor logic ( #630 )
...
### What problem does this PR solve?
Optimize task broker and executor for reduce memory usage and deployment
complexity.
### Type of change
- [x] Performance Improvement
- [x] Refactoring
### Change Log
- Enhance redis utils for message queue(use stream)
- Modify task broker logic via message queue (1.get parse event from
message queue 2.use ThreadPoolExecutor async executor )
- Modify the table column name of document and task (process_duation ->
process_duration maybe just a spelling mistake)
- Reformat some code style(just what i see)
- Add requirement_dev.txt for developer
- Add redis container on docker compose
---------
Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
2024-05-07 11:43:33 +08:00
KevinHuSh
5f03a4de11
remove redis ( #629 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-04-30 19:00:41 +08:00
KevinHuSh
8c07992b6c
refine code ( #595 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-04-28 19:13:33 +08:00
KevinHuSh
9d60a84958
refactor code ( #583 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-04-28 13:19:54 +08:00
KevinHuSh
038822f3bd
make cites in conversation API configurable ( #576 )
...
### What problem does this PR solve?
#566
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-04-28 11:56:17 +08:00
KevinHuSh
944776f207
fix bug about fetching file from minio ( #574 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-04-28 09:57:40 +08:00
KevinHuSh
ab06f502d7
fix bug of file management ( #565 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-04-26 19:59:21 +08:00
KevinHuSh
f69ff39fa0
add file management feature ( #560 )
...
### What problem does this PR solve?
### Type of change
- [x] Documentation Update
2024-04-26 17:21:53 +08:00
chrysanthemum-boy
26003b5076
Add upload file by knowledge base name API. ( #539 )
...
### What problem does this PR solve?
Add upload file by knowledge base name API.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
- [x] Documentation Update
---------
Co-authored-by: chrysanthemum-boy <fannc@qq.com>
2024-04-25 15:10:19 +08:00
KevinHuSh
66f8d35632
Refactor ( #537 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2024-04-25 14:14:28 +08:00
KevinHuSh
ed6081845a
Fit a lot of encodings for text file. ( #458 )
...
### What problem does this PR solve?
#384
### Type of change
- [x] Performance Improvement
2024-04-19 18:02:53 +08:00
KevinHuSh
03f8b01b3b
fix bug for fasetembed ( #392 )
...
### What problem does this PR solve?
Issue link:#325
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2024-04-16 19:12:12 +08:00
KevinHuSh
890561703b
Add bce-embedding and fastembed ( #383 )
...
### What problem does this PR solve?
Issue link:#326
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-04-16 16:42:19 +08:00
KevinHuSh
c39b751600
conversation API backend update ( #360 )
...
### What problem does this PR solve?
Issue link:#345
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2024-04-15 14:43:44 +08:00
