769 Commits

Author SHA1 Message Date
KevinHuSh
d32322c081
rename vision, add layour and tsr recognizer (#70)
* rename vision, add layour and tsr recognizer

* trivial fixing
2024-02-22 19:11:37 +08:00
balibabu
5a0f1d2b84
feat: fetch conversation and delete chat dialog (#69)
* feat: set chat configuration to backend

* feat: exclude unEnabled variables

* feat: delete chat dialog

* feat: fetch conversation
2024-02-22 17:14:25 +08:00
KevinHuSh
cacd36c5e1
use onnx models, new deepdoc (#68) 2024-02-21 16:32:38 +08:00
balibabu
8c4ec9955e feat: create a chat assistant and extract SimilaritySlider (#67)
* feat: extract SimilaritySlider

* feat: create a chat assistant
2024-02-20 18:10:20 +08:00
KevinHuSh
a8294f2168 Refine resume parts and fix bugs in retrival using sql (#66) 2024-02-19 19:22:17 +08:00
balibabu
452020d33a feat: add temperature and top-p to ModelSetting and add ChatConfigurationModal and bind backend data to KnowledgeCard (#65)
* feat: bind backend data to KnowledgeCard

* feat: add ChatConfigurationModal

* feat: add temperature and top-p to ModelSetting
2024-02-19 19:16:23 +08:00
balibabu
f3d0ebd293 feat: remove KnowledgeSearching and add knowledge configuration page and add a run button to the document (#64)
* feat: add a run button to the document

* feat: add knowledge configuration page

* feat: remove KnowledgeSearching
2024-02-18 18:18:20 +08:00
balibabu
53be70c7a9 feat: transform the parser's data structure and add Image to TestingResult (#63)
* feat: add Image to TestingResult

* feat: transform the parser's data structure
2024-02-08 18:50:11 +08:00
balibabu
1a156e6569 feat: test document chunks (#62) 2024-02-08 18:12:31 +08:00
KevinHuSh
5e0a689c43 refactor retieval_test, add SQl retrieval methods (#61) 2024-02-08 17:01:01 +08:00
balibabu
0a903c7714 feat: add SelectFiles and add KnowledgeTesting (#60)
* feat: add KnowledgeTesting

* feat: add SelectFiles
2024-02-08 11:58:43 +08:00
KevinHuSh
c5ea37cd30 Add resume parser and fix bugs (#59)
* Update .gitignore

* Update .gitignore

* Add resume parser and fix bugs
2024-02-07 19:27:23 +08:00
balibabu
eb8254e688 feat: create chunk and edit chunk and delete chunk (#58)
* feat: create chunk and edit chunk

* feat: delete chunk

* feat: search chunks

* feat: delete chunks in batches

* feat: set whether chunks are available in batches
2024-02-07 18:04:25 +08:00
balibabu
97d4387982 feat: set chunk to available state and select all chunk (#57)
* feat: set chunk to available state

* feat: select all chunk
2024-02-06 18:45:20 +08:00
balibabu
eb381963b3 feat: confirm before deleting knowledge base and add ChunkToolBar (#56)
* feat: confirm before deleting knowledge base

* feat: add ChunkToolBar
2024-02-05 19:26:03 +08:00
KevinHuSh
407b2523b6 remove unused codes, seperate layout detection out as a new api. Add new rag methed 'table' (#55) 2024-02-05 18:08:17 +08:00
balibabu
f305776217 feat: save the selected parser to the backend on the upload file page and upload document (#54)
* feat: add pagination to document table

* feat: fetch document list by page

* feat: poll the document list

* feat: upload document

* feat: save the selected parser to the backend on the upload file page
2024-02-05 12:01:27 +08:00
KevinHuSh
51482f3e2a Some document API refined. (#53)
Add naive chunking method to RAG
2024-02-02 19:21:37 +08:00
balibabu
7b71fb2db6 feat: modify routing to nested mode and rename document (#52)
* feat: modify routing to nested mode

* feat: rename document
2024-02-02 18:49:54 +08:00
balibabu
503735cd1d feat: Modify the color of the svg icon in the header according to the selected state and feat: extract routing information from the knowledge base into constants (#51)
* feat: Modify the color of the svg icon in the header according to the selected state

* feat: add translation icon to header

* feat: shorten the route length of the knowledge base

* feat: extract routing information from the knowledge base into constants
2024-02-02 09:35:21 +08:00
KevinHuSh
e6acaf6738 Add Q&A and Book, fix task running bugs (#50) 2024-02-01 18:53:56 +08:00
KevinHuSh
6224edcd1b Add task moduel, and pipline the task and every parser (#49) 2024-01-31 19:57:45 +08:00
balibabu
af3ef26977 feat: layout the knowledge list page and modify the page switching button in the header (#48)
* feat: remove unnecessary 'loading' fields from other files

* feat: layout the knowledge list page

* feat: modify the page switching button in the header
2024-01-31 19:29:57 +08:00
balibabu
362ec6c364 feat: remove loading from model and use DvaModel instead of redundant types such as kAModelType (#47)
* feat: use DvaModel instead of redundant types such as kAModelType

* feat: set the type for registerServer

* feat: remove loading from model
2024-01-30 19:26:29 +08:00
KevinHuSh
96a1a44cb6 add paper & manual parser (#46) 2024-01-30 18:28:09 +08:00
balibabu
04aba1bb65 feat: prevent the user from entering the knowledge base if he is not logged in (#45) 2024-01-29 19:28:39 +08:00
balibabu
e1bc1d46e6 feat: install prettier to format code and add react-dev-inspector to locate code in the IDE faster (#44)
* feat: add react-dev-inspector to locate code in the IDE faster

* feat: install prettier to format code

---------

Co-authored-by: yangqianjuan <1072483500@qq.com>
2024-01-29 15:02:27 +08:00
KevinHuSh
072f9dd5bc Add app to rag module: presentaion & laws (#43) 2024-01-25 18:57:39 +08:00
KevinHuSh
e32ef75e99 Test chat API and refine ppt chunker (#42) 2024-01-23 19:45:36 +08:00
KevinHuSh
34b2ab3b2f Test APIs and fix bugs (#41) 2024-01-22 19:51:38 +08:00
KevinHuSh
484e5abc1f llm configuation refine and trievalTest API refine (#40) 2024-01-19 19:51:57 +08:00
yqj123
f3dd131403 set port (#39)
* set port

* add knowledge-search

* update text
2024-01-19 18:35:24 +08:00
yqj123
103e12b7c2 update api (#38) 2024-01-19 11:08:07 +08:00
yqj123
c4f72317a2 update port (#36) 2024-01-19 10:45:37 +08:00
KevinHuSh
4a858d33b6 add conversation API (#35) 2024-01-18 19:28:37 +08:00
yqj123
fad2ec7cf3 update knowledge_kb (#34)
* update typescript

* add chunk api

* remove useless code
2024-01-18 18:27:38 +08:00
KevinHuSh
9bf75d4511 add dialog api (#33) 2024-01-17 20:20:42 +08:00
KevinHuSh
6be3dd56fa rename web_server to api (#29)
* add front end code

* change licence

* rename web_server to API

* change name to web_server
2024-01-17 09:43:27 +08:00
KevinHuSh
c372afe40a change licence (#28)
* add front end code

* change licence
2024-01-17 09:39:50 +08:00
KevinHuSh
6b8fc2ce1f add front end code (#27) 2024-01-17 09:37:01 +08:00
KevinHuSh
3859fce6bf rm wrongly uploaded folder (#24) 2024-01-15 19:51:48 +08:00
KevinHuSh
3198faf2d2 add alot of api (#23)
* clean rust version project

* clean rust version project

* build python version rag-flow

* add alot of api
2024-01-15 19:47:25 +08:00
KevinHuSh
30791976d5 build python version rag-flow (#21)
* clean rust version project

* clean rust version project

* build python version rag-flow
2024-01-15 08:46:22 +08:00
Kould
db8cae3f1e feat: impl websocket upload file for doc_info (#20) 2023-12-29 10:09:23 +08:00
KevinHuSh
d0db329fef add llm API (#19)
* add llm API

* refine llm API
2023-12-28 13:50:13 +08:00
KevinHuSh
cdd956568d finish add thumbnail to video,image,pdf files (#18) 2023-12-27 17:49:09 +08:00
KevinHuSh
3fc700a1d4 build dialog server; add thumbnail to docinfo; (#17) 2023-12-26 19:32:06 +08:00
KevinHuSh
3245107dc7 use minio to store uploaded files; build dialog server; (#16)
* format code

* use minio to store uploaded files; build dialog server;
2023-12-25 19:05:59 +08:00
KevinHuSh
d4fd138954 Update .env.template 2023-12-25 12:28:54 +08:00
Kould
f4d1c724dd support S3 for file storage (#15)
* feat: support S3 for file storage

* doc: fmt env template
2023-12-25 11:02:27 +08:00