258 Commits

Author SHA1 Message Date
KevinHuSh
c5ea37cd30 Add resume parser and fix bugs (#59)
* Update .gitignore

* Update .gitignore

* Add resume parser and fix bugs
2024-02-07 19:27:23 +08:00
balibabu
eb8254e688 feat: create chunk and edit chunk and delete chunk (#58)
* feat: create chunk and edit chunk

* feat: delete chunk

* feat: search chunks

* feat: delete chunks in batches

* feat: set whether chunks are available in batches
2024-02-07 18:04:25 +08:00
balibabu
97d4387982 feat: set chunk to available state and select all chunk (#57)
* feat: set chunk to available state

* feat: select all chunk
2024-02-06 18:45:20 +08:00
balibabu
eb381963b3 feat: confirm before deleting knowledge base and add ChunkToolBar (#56)
* feat: confirm before deleting knowledge base

* feat: add ChunkToolBar
2024-02-05 19:26:03 +08:00
KevinHuSh
407b2523b6 remove unused codes, seperate layout detection out as a new api. Add new rag methed 'table' (#55) 2024-02-05 18:08:17 +08:00
balibabu
f305776217 feat: save the selected parser to the backend on the upload file page and upload document (#54)
* feat: add pagination to document table

* feat: fetch document list by page

* feat: poll the document list

* feat: upload document

* feat: save the selected parser to the backend on the upload file page
2024-02-05 12:01:27 +08:00
KevinHuSh
51482f3e2a Some document API refined. (#53)
Add naive chunking method to RAG
2024-02-02 19:21:37 +08:00
balibabu
7b71fb2db6 feat: modify routing to nested mode and rename document (#52)
* feat: modify routing to nested mode

* feat: rename document
2024-02-02 18:49:54 +08:00
balibabu
503735cd1d feat: Modify the color of the svg icon in the header according to the selected state and feat: extract routing information from the knowledge base into constants (#51)
* feat: Modify the color of the svg icon in the header according to the selected state

* feat: add translation icon to header

* feat: shorten the route length of the knowledge base

* feat: extract routing information from the knowledge base into constants
2024-02-02 09:35:21 +08:00
KevinHuSh
e6acaf6738 Add Q&A and Book, fix task running bugs (#50) 2024-02-01 18:53:56 +08:00
KevinHuSh
6224edcd1b Add task moduel, and pipline the task and every parser (#49) 2024-01-31 19:57:45 +08:00
balibabu
af3ef26977 feat: layout the knowledge list page and modify the page switching button in the header (#48)
* feat: remove unnecessary 'loading' fields from other files

* feat: layout the knowledge list page

* feat: modify the page switching button in the header
2024-01-31 19:29:57 +08:00
balibabu
362ec6c364 feat: remove loading from model and use DvaModel instead of redundant types such as kAModelType (#47)
* feat: use DvaModel instead of redundant types such as kAModelType

* feat: set the type for registerServer

* feat: remove loading from model
2024-01-30 19:26:29 +08:00
KevinHuSh
96a1a44cb6 add paper & manual parser (#46) 2024-01-30 18:28:09 +08:00
balibabu
04aba1bb65 feat: prevent the user from entering the knowledge base if he is not logged in (#45) 2024-01-29 19:28:39 +08:00
balibabu
e1bc1d46e6 feat: install prettier to format code and add react-dev-inspector to locate code in the IDE faster (#44)
* feat: add react-dev-inspector to locate code in the IDE faster

* feat: install prettier to format code

---------

Co-authored-by: yangqianjuan <1072483500@qq.com>
2024-01-29 15:02:27 +08:00
KevinHuSh
072f9dd5bc Add app to rag module: presentaion & laws (#43) 2024-01-25 18:57:39 +08:00
KevinHuSh
e32ef75e99 Test chat API and refine ppt chunker (#42) 2024-01-23 19:45:36 +08:00
KevinHuSh
34b2ab3b2f Test APIs and fix bugs (#41) 2024-01-22 19:51:38 +08:00
KevinHuSh
484e5abc1f llm configuation refine and trievalTest API refine (#40) 2024-01-19 19:51:57 +08:00
yqj123
f3dd131403 set port (#39)
* set port

* add knowledge-search

* update text
2024-01-19 18:35:24 +08:00
yqj123
103e12b7c2 update api (#38) 2024-01-19 11:08:07 +08:00
yqj123
c4f72317a2 update port (#36) 2024-01-19 10:45:37 +08:00
KevinHuSh
4a858d33b6 add conversation API (#35) 2024-01-18 19:28:37 +08:00
yqj123
fad2ec7cf3 update knowledge_kb (#34)
* update typescript

* add chunk api

* remove useless code
2024-01-18 18:27:38 +08:00
KevinHuSh
9bf75d4511 add dialog api (#33) 2024-01-17 20:20:42 +08:00
KevinHuSh
6be3dd56fa rename web_server to api (#29)
* add front end code

* change licence

* rename web_server to API

* change name to web_server
2024-01-17 09:43:27 +08:00
KevinHuSh
c372afe40a change licence (#28)
* add front end code

* change licence
2024-01-17 09:39:50 +08:00
KevinHuSh
6b8fc2ce1f add front end code (#27) 2024-01-17 09:37:01 +08:00
KevinHuSh
3859fce6bf rm wrongly uploaded folder (#24) 2024-01-15 19:51:48 +08:00
KevinHuSh
3198faf2d2 add alot of api (#23)
* clean rust version project

* clean rust version project

* build python version rag-flow

* add alot of api
2024-01-15 19:47:25 +08:00
KevinHuSh
30791976d5 build python version rag-flow (#21)
* clean rust version project

* clean rust version project

* build python version rag-flow
2024-01-15 08:46:22 +08:00
Kould
db8cae3f1e feat: impl websocket upload file for doc_info (#20) 2023-12-29 10:09:23 +08:00
KevinHuSh
d0db329fef add llm API (#19)
* add llm API

* refine llm API
2023-12-28 13:50:13 +08:00
KevinHuSh
cdd956568d finish add thumbnail to video,image,pdf files (#18) 2023-12-27 17:49:09 +08:00
KevinHuSh
3fc700a1d4 build dialog server; add thumbnail to docinfo; (#17) 2023-12-26 19:32:06 +08:00
KevinHuSh
3245107dc7 use minio to store uploaded files; build dialog server; (#16)
* format code

* use minio to store uploaded files; build dialog server;
2023-12-25 19:05:59 +08:00
KevinHuSh
d4fd138954 Update .env.template 2023-12-25 12:28:54 +08:00
Kould
f4d1c724dd support S3 for file storage (#15)
* feat: support S3 for file storage

* doc: fmt env template
2023-12-25 11:02:27 +08:00
KevinHuSh
6858ec5f38 format code (#14) 2023-12-25 10:17:13 +08:00
KevinHuSh
8a65ad888e add seed data generation (#13)
* merge upstream

* add seed data generation
2023-12-22 20:02:16 +08:00
KevinHuSh
1eb186a25f go through smoke test of all API (#12)
* add field progress msg into docinfo; add file processing procedure

* go through upload, create kb, add doc to kb

* smoke test for all API

* smoke test for all API
2023-12-22 17:57:27 +08:00
KevinHuSh
72b7b5fae5 Update .env 2023-12-21 10:14:10 +08:00
KevinHuSh
249b27c1e0 go through upload, create kb, add doc to kb (#11)
* add field progress msg into docinfo; add file processing procedure

* go through upload, create kb, add doc to kb
2023-12-19 19:28:01 +08:00
Kould
d94c6df4a4 feat: Implement authentication (#10)
Co-authored-by: kould <2435992353@qq.com>
2023-12-18 15:52:52 +08:00
KevinHuSh
c64dcb929b Update .env 2023-12-18 10:28:33 +08:00
KevinHuSh
b132c4f642 Create docker .env 2023-12-18 10:20:52 +08:00
Kould
b772fd3b0b impl kb_info & dialog_info & doc_info (#9)
* feat: impl kb_info & dialog_info

* feat: impl doc_info apis
2023-12-15 20:29:28 +08:00
KevinHuSh
738c322508 add docker compose (#8)
* add docker compose

* add docker compose
2023-12-15 19:38:32 +08:00
KevinHuSh
f4456af464 init python part (#7) 2023-12-14 19:19:03 +08:00