78 Commits

Author SHA1 Message Date
pyyuhao
5d6bf2224a
Fix: Opensearch chunk management ()
### What problem does this PR solve?

This PR solve the problems metioned in the
pr(https://github.com/infiniflow/ragflow/pull/7140) which is also
submitted by me

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [ ] New Feature (non-breaking change which adds functionality)
- [ ] Documentation Update
- [ ] Refactoring
- [ ] Performance Improvement
- [ ] Other (please describe):


### Introduction
I fixed the problems when using OpenSearch as the DOC_ENGINE, the
failures of pytest and the wrong API's return.
Mainly about delete chunk, list chunks, update chunk, retrieval chunk.
The pytest comand "cd sdk/python && uv sync --python 3.10 --group test
--frozen && source .venv/bin/activate && cd test/test_http_api &&
DOC_ENGINE=opensearch pytest test_chunk_management_within_dataset -s
--tb=short " is finally successful.

###Others
As some changes between Elasticsearch And Opensearch differ, some pytest
results about OpenSearch are correct and resonable. However, some pytest
params (skipif params) are incompatible. So I changed some pytest params
about skipif.

As a search engine programmer, I will still focus on the usage of vector
databases (especially OpenSearch) for the RAG stuff.
Thanks for your review
2025-05-26 16:57:58 +08:00
liu an
e166f132b3 Feat: change default models ()
### What problem does this PR solve?

change default models to buildin models
https://github.com/infiniflow/ragflow/issues/7774

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
2025-05-23 18:21:25 +08:00
liu an
fed1221302
Refa: HTTP API list datasets / test cases / docs ()
### What problem does this PR solve?

This PR introduces Pydantic-based validation for the list datasets HTTP
API, improving code clarity and robustness. Key changes include:

Pydantic Validation
Error Handling
Test Updates
Documentation Updates

### Type of change

- [x] Documentation Update
- [x] Refactoring
2025-05-20 09:58:26 +08:00
liu an
59705a1c1d
Test: change variable for ZHIPU_AI_API_KEY ()
### What problem does this PR solve?

change variable for ZHIPU_AI_API_KEY

### Type of change

- [x] Update test case
2025-05-16 15:58:54 +08:00
liu an
04edf9729f
Test: use environment variable for ZHIPU_AI_API_KEY ()
### What problem does this PR solve?

use environment variable for ZHIPU_AI_API_KEY

### Type of change

- [x] Test update
2025-05-16 13:51:21 +08:00
liu an
ae8b628f0a
Refa: HTTP API delete dataset / test cases / docs ()
### What problem does this PR solve?

This PR introduces Pydantic-based validation for the delete dataset HTTP
API, improving code clarity and robustness. Key changes include:

1. Pydantic Validation
2. Error Handling
3. Test Updates
4. Documentation Updates

### Type of change

- [x] Documentation Update
- [x] Refactoring
2025-05-16 10:16:43 +08:00
liu an
f8cc557892
Fix(api): correct default value handling in dataset parser config ()
### What problem does this PR solve?

Fix  HTTP API Create/Update dataset parser config default value error

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
2025-05-12 19:39:18 +08:00
liu an
ef0c4b134d
Test: skip unstable test cases ()
### What problem does this PR solve?

Skip unstable test cases to ensure daily testing stability

### Type of change

- [x] Update test cases
2025-05-12 09:49:14 +08:00
liu an
35e36cb945
Refa: HTTP API update dataset / test cases / docs ()
### What problem does this PR solve?

This PR introduces Pydantic-based validation for the update dataset HTTP
API, improving code clarity and robustness. Key changes include:
1. Pydantic Validation
2. ​​Error Handling
3. Test Updates
4. Documentation Updates
5. fix bug: 

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Documentation Update
- [x] Refactoring
2025-05-09 19:17:08 +08:00
liu an
0fbca63e9d
Test: Configure test case priorities to reduce CI execution time ()
### What problem does this PR solve?

Configure test case priorities to reduce CI execution time

### Type of change

- [x] Test cases update
2025-05-08 19:22:52 +08:00
liu an
c98933499a
refa: Optimize create dataset validation ()
### What problem does this PR solve?

Optimize dataset validation and add function docs

### Type of change

- [x] Refactoring
2025-05-06 17:38:06 +08:00
liu an
fc379e90d1
Fix: change create dataset htto api delimiter default value to r'\n' ()
### What problem does this PR solve?

change create dataset delimiter default value to r'\n'

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
2025-04-30 17:43:42 +08:00
liu an
1f82889001
Fix: create dataset remove unnecessary parameter constraints ()
### What problem does this PR solve?

Remove unnecessary parameter restrictions in dataset creation API

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
2025-04-30 14:50:23 +08:00
liu an
e6c824e606
Test: Update tests to use new fixture instead of deprecated one ()
### What problem does this PR solve?

Deprecate get_dataset_id_and_document_id fixture, use add_document
instead

### Type of change

- [x] Update test cases
2025-04-30 14:49:26 +08:00
liu an
78380fa181
Refa: http API create dataset and test cases ()
### What problem does this PR solve?

This PR introduces Pydantic-based validation for the create dataset HTTP
API, improving code clarity and robustness. Key changes include:
1. Pydantic Validation
2. ​​Error Handling
3. Test Updates
4. Documentation

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Documentation Update
- [x] Refactoring
2025-04-29 16:53:57 +08:00
Kevin Hu
c7310f7fb2
Refa: similarity calculations. ()
### What problem does this PR solve?


### Type of change

- [x] Refactoring
2025-04-28 19:17:11 +08:00
Yongteng Lei
94181a990b
Refa: knowledge_graph chunk method is deprecated ()
### What problem does this PR solve?

The knowledge_graph chunk method is deprecated and should no longer be
used. .

### Type of change

- [x] Refactoring
2025-04-23 13:01:46 +08:00
Yongteng Lei
67dee2d74e
Fix: fix retrieval tesing wrong pagination ()
### What problem does this PR solve?

Fix retrieval testing wrong pagination.  

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

---------

Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
2025-04-22 15:16:04 +08:00
liu an
e5f9d148e7
Test: Added test cases for Delete Sessions With Chat Assistant HTTP API ()
### What problem does this PR solve?

cover [Delete chat assistant's
sessions](https://ragflow.io/docs/dev/http_api_reference#delete-chat-assistants-sessions)
endpoints

### Type of change

- [x] Add test cases
2025-04-15 14:54:26 +08:00
liu an
9b789c2ae9
Test: Added test cases for Update Session With Chat Assistant HTTP API ()
### What problem does this PR solve?

cover [Update chat assistant's
sessions](https://ragflow.io/docs/dev/http_api_reference#update-chat-assistants-session)
endpoints

### Type of change

- [x] Update test cases
2025-04-11 20:10:24 +08:00
liu an
ffb9f01bea
Test: Update test cases for PR 6906 ISSUE 6875 ()
### What problem does this PR solve?

PR  ISSUE 

### Type of change

- [ ] Update test cases
2025-04-11 20:09:44 +08:00
liu an
dc59aba132
Test: Added test cases for List Sessions With Chat Assistant HTTP API ()
### What problem does this PR solve?

cover [List chat assistant's
sessions](https://ragflow.io/docs/dev/http_api_reference#list-chat-assistants-sessions)
endpoints

### Type of change

- [x] Update test cases
2025-04-10 17:31:01 +08:00
liu an
8fb5edd927
Test: Update test cases for PR 6906 ()
### What problem does this PR solve?

PR 

### Type of change

- [x] Update test cases
2025-04-10 12:28:56 +08:00
Kevin Hu
3bb1e012e6
Fix: assistant deleteion issue. ()
### What problem does this PR solve?



### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
2025-04-09 20:29:40 +08:00
liu an
22758a2763
Test: Update test cases for PR 6888 ISSUE 6876 ()
### What problem does this PR solve?

PR  ISSUE 

### Type of change

- [x] Update test case
2025-04-09 20:29:29 +08:00
liu an
ae107f31d9
Test: Added test cases for Create Session With Chat Assistant HTTP API ()
### What problem does this PR solve?

cover [create session with chat
assistant](https://ragflow.io/docs/dev/http_api_reference#create-session-with-chat-assistant)
endpoints

### Type of change

- [x] add test cases
2025-04-09 17:21:48 +08:00
liu an
c26c38ee12
Test: Added test cases for Delete Chat Assistants HTTP API ()
### What problem does this PR solve?

cover [delete chat
assistants](https://ragflow.io/docs/dev/http_api_reference#delete-chat-assistants)
endpoints

### Type of change

- [x] add test cases
2025-04-08 18:53:02 +08:00
liu an
a1fb32908d
Fix: Error message is incorrect when updating chat name ()
### What problem does this PR solve?

 

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
2025-04-07 17:13:17 +08:00
liu an
0b89458eb8
Test: Added test cases for Update Chat Assistant HTTP API ()
### What problem does this PR solve?

cover [update chat
assistant](https://ragflow.io/docs/v0.17.2/http_api_reference#update-chat-assistant)
endpoints

### Type of change

- [x] add test cases
2025-04-07 15:04:23 +08:00
liu an
2a5ad74ac6
Test: Update test cases for ()
### What problem does this PR solve?

update test case for PR  issue 

### Type of change

- [x] update test cases
2025-04-03 21:22:41 +08:00
liu an
b213e88cca
Test: Added test cases for List Chat Assistants HTTP API ()
### What problem does this PR solve?

cover [list chat
assistant](https://ragflow.io/docs/v0.17.2/http_api_reference#list-chat-assistants)
endpoints

### Type of change

- [x] add test cases
2025-04-03 17:22:23 +08:00
liu an
58f8026632
Test: Update test cases for PR ()
### What problem does this PR solve?

Update test cases for PR  issue 

### Type of change

- [x] update test cases
2025-04-03 10:10:40 +08:00
liwenju0
a73fbc61ff
Fix: Handle the case of deleting empty blocks. Update the relevant message ()
…gic to return the correct deletion message. Add handling for empty
arrays to ensure no errors occur during the deletion operation. Update
the test cases to verify the new logic.

### What problem does this PR solve?

fix this bug:https://github.com/infiniflow/ragflow/issues/6607

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

---------

Co-authored-by: wenju.li <wenju.li@deepctr.cn>
2025-04-02 19:20:17 +08:00
liu an
0d1c5fdd2f
Test: Added test cases for Create Chat Assistant HTTP API ()
### What problem does this PR solve?

cover [create chat
assistant](https://ragflow.io/docs/v0.17.2/http_api_reference#create-chat-assistant)
endpoints

### Type of change

- [x] add test cases
2025-04-02 18:49:59 +08:00
liu an
3ae1e9e3c4
Test: Skip test case for PR 6443 ()
### What problem does this PR solve?

Skip test case for PR 

### Type of change

- [x] update test cases
2025-04-02 10:41:01 +08:00
liu an
58e6e7b668
Test: Refactor test fixtures and test cases ()
### What problem does this PR solve?

 Refactor test fixtures and test cases

### Type of change

- [ ] Refactoring test cases
2025-04-01 13:39:07 +08:00
Kevin Hu
7d9dd1e5d3
Refa: remove default build-in rerank model. ()
### What problem does this PR solve?

### Type of change

- [x] Refactoring
- [x] Performance Improvement
2025-03-31 15:33:19 +08:00
liu an
aca4cf4369
Test: Added test cases for Retrieval Chunks HTTP API ()
### What problem does this PR solve?

cover [retrieval
chunk](https://ragflow.io/docs/v0.17.2/http_api_reference#retrieve-chunks)
endpoints

### Type of change

- [x]  add test cases
2025-03-31 10:05:35 +08:00
Kevin Hu
1fbc4870f0
Fix: HTTP API delete_chunks issue. ()
### What problem does this PR solve?



### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
2025-03-28 12:13:43 +08:00
liu an
fd614a7aef
Test: Added test cases for Delete Chunks HTTP API ()
### What problem does this PR solve?

_Briefly describe what this PR aims to solve. Include background context
that will help reviewers understand the purpose of the PR._

### Type of change

- [x] add test cases
2025-03-28 09:33:23 +08:00
liu an
6599db1e99
Test: Update test cases for PR ()
### What problem does this PR solve?

PR   

### Type of change

- [x] update test cases
2025-03-26 19:23:13 +08:00
liu an
93c26ae1ef
Test: Added test cases for Update Chunk HTTP API ()
### What problem does this PR solve?

cover [update
chunk](https://ragflow.io/docs/v0.17.2/http_api_reference#update-chunk)
endpoints

### Type of change

- [x] add test cases
2025-03-26 16:47:47 +08:00
liu an
0a79dfd5cf
Test: Added test cases for List Chunks HTTP API ()
### What problem does this PR solve?

cover [list
chunks](https://ragflow.io/docs/v0.17.2/http_api_reference#list-chunks)
endpoints

### Type of change

- [x] update test cases
2025-03-25 17:28:58 +08:00
liu an
27989eb9a5
Test: Add list chunk checkpoint for the add chunk API ()
### What problem does this PR solve?

Add list chunk checkpoint for the add chunk API

### Type of change

- [x] update test cases
2025-03-25 10:36:21 +08:00
liu an
b6f3242c6c
Test: Update test cases to reduce execution time ()
### What problem does this PR solve?

_Briefly describe what this PR aims to solve. Include background context
that will help reviewers understand the purpose of the PR._

### Type of change

- [x] update test cases
2025-03-25 09:17:05 +08:00
liu an
0b63346a1a
Test: Update test case for ()
### What problem does this PR solve?

Update test case for 

### Type of change

- [x] Update test case
2025-03-24 13:18:12 +08:00
liu an
e4c8d703b5
Test: Update test cases for PR ()
### What problem does this PR solve?

PR   

### Type of change

- [x] Update test cases
2025-03-24 12:01:33 +08:00
liu an
8eefc8b5fe
Test: Added test cases for Add Chunk HTTP API ()
### What problem does this PR solve?

cover [add
chunk](https://ragflow.io/docs/v0.17.2/http_api_reference#add-chunk)
endpoints

### Type of change

- [x] Add test cases
2025-03-21 19:16:30 +08:00
hy89
1d9ca172e3
Fix(api): correct document parsing progress check logic ()
- Fix incorrect progress check condition that prevented re-parsing of
completed documents
- Allow parsing for documents with progress 0.0 (not started) or 1.0
(completed)
- Only block parsing for documents currently in progress (0.0 < progress
< 1.0)

Close 

---------

Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
2025-03-20 16:00:17 +08:00
liu an
4eb3a8e1cc
Test: Skip unstable 'stop parse documents' test cases ()
### What problem does this PR solve?

 Skip unstable 'stop parse documents' test cases

### Type of change

- [x] update test cases
2025-03-20 11:35:19 +08:00