AI/ragflow
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/infiniflow/ragflow.git synced 2025-06-04 11:24:00 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,252 Commits 2 Branches 27 Tags
Commit Graph

525 Commits

Author SHA1 Message Date
Kevin Hu
9ff825f39d
Ignore exceptions when no index ahead. (#5047) 
### What problem does this PR solve?

### Type of change

- [x] Refactoring
 2025-02-18 09:09:22 +08:00
Kevin Hu
3aa5c2a699
Ignore exception of empty index. (#5030) 
### What problem does this PR solve?

### Type of change


- [x] Refactoring
 2025-02-17 15:59:55 +08:00
saikidev
d2929e432e
Feat: add LLM provider PPIO (#5013) 
### What problem does this PR solve?

Add a LLM provider: PPIO

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Documentation Update
 2025-02-17 12:03:26 +08:00
Kevin Hu
29ceeba95f
Fix hit cache error while raptoring. (#4955) 
### What problem does this PR solve?

#4126

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-02-14 12:00:19 +08:00
Kevin Hu
b08bb56f6c
Display thinking for deepseek r1 (#4904) 
### What problem does this PR solve?
#4903
### Type of change

- [x] New Feature (non-breaking change which adds functionality)
 2025-02-12 15:43:13 +08:00
Mathias Panzenböck
9bcccadebd
Remove use of eval() from search.py (#4887) 
Use `json.loads()` instead.

### What problem does this PR solve?

Using `eval()` can lead to code injections. I think this loads a JSON
field, right? If yes, why is this done via `eval()` and not
`json.loads()`?

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-02-12 13:15:38 +08:00
Kevin Hu
0d3ed37b48
Make the update script shorter. (#4854) 
### What problem does this PR solve?


### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-02-10 18:18:49 +08:00
Kevin Hu
f374dd38b6
Fix divided by zero issue. (#4784) 
### What problem does this PR solve?

#4779

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-02-08 10:36:26 +08:00
Kevin Hu
2aa0cdde8f
Fix Gemini chat issue. (#4757) 
### What problem does this PR solve?

#4753

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-02-07 12:00:19 +08:00
Kevin Hu
448fa1c4d4
Robust for abnormal response from LLMs. (#4747) 
### What problem does this PR solve?


### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-02-06 17:34:53 +08:00
Kevin Hu
6f2c3a3c3c
Fix too long query exception. (#4729) 
### What problem does this PR solve?


### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-02-06 10:11:52 +08:00
Kevin Hu
283d036cba
Fitin for infinity. (#4722) 
### What problem does this PR solve?

### Type of change

- [x] Refactoring
 2025-02-05 16:47:05 +08:00
Kyle
036f37a627
fix: err object has no attribute 'iter_lines' (#4686) 
### What problem does this PR solve?

ERROR: 'Stream' object has no attribute 'iter_lines' with reference to
Claude/Anthropic chat streams

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

Co-authored-by: Kyle Olmstead <k.olmstead@offensive-security.com>
 2025-02-01 22:39:30 +08:00
Kevin Hu
c354239b79
Make infinity adapt to condition exist. (#4657) 
### What problem does this PR solve?

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-26 18:45:36 +08:00
Kevin Hu
4776fa5e4e
Refactor for total_tokens. (#4652) 
### What problem does this PR solve?

#4567
### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-26 13:54:26 +08:00
Kevin Hu
c24137bd11
Fix too long integer for Table. (#4651) 
### What problem does this PR solve?

#4594

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-26 12:54:58 +08:00
Kevin Hu
4011c8f68c
Fix potential error. (#4650) 
### What problem does this PR solve?
#4622

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-26 12:38:32 +08:00
writinwaters
2cb8edc42c
Added GPUStack (#4649) 
### What problem does this PR solve?



### Type of change


- [x] Documentation Update
 2025-01-26 12:25:02 +08:00
Kevin Hu
530b0dab17
Make infinity able to cal embedding sim only. (#4644) 
### What problem does this PR solve?


### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-26 10:29:52 +08:00
Kevin Hu
71c132f76d
Make infinity adapt (#4635) 
### What problem does this PR solve?

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-24 17:45:04 +08:00
Kevin Hu
9d717f0b6e
Fix csv reader exception. (#4628) 
### What problem does this PR solve?

#4552
### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-24 14:47:19 +08:00
Kevin Hu
f1d9f4290e
Fix TogetherAIEmbed. (#4623) 
### What problem does this PR solve?

#4567

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-24 10:29:30 +08:00
Kevin Hu
55f2b7c4d5
Code format. (#4611) 
### What problem does this PR solve?


### Type of change

- [x] Refactoring
 2025-01-23 18:43:32 +08:00
Kevin Hu
86892959a0
Rebuild graph when it's out of time. (#4607) 
### What problem does this PR solve?

#4543

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Refactoring
 2025-01-23 17:26:20 +08:00
Kevin Hu
13f04b7cca
Fix pdf applying Q&A issue. (#4599) 
### What problem does this PR solve?


### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-23 12:30:46 +08:00
Kevin Hu
dd0ebbea35
Light GraphRAG (#4585) 
### What problem does this PR solve?

#4543

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
 2025-01-22 19:43:14 +08:00
Jin Hai
3894de895b
Update comments (#4569) 
### What problem does this PR solve?

Add license statement.

### Type of change

- [x] Refactoring

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2025-01-21 20:52:28 +08:00
Kevin Hu
3805621564
Fix xinference rerank issue. (#4499) 
### What problem does this PR solve?
#4495
### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-16 11:35:51 +08:00
Kevin Hu
c852a6dfbf
Accelerate titles' embeddings. (#4492) 
### What problem does this PR solve?


### Type of change

- [x] Performance Improvement
 2025-01-15 15:20:29 +08:00
Kevin Hu
be5f830878
Truncate text for zhipu embedding. (#4490) 
### What problem does this PR solve?


### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-15 14:36:27 +08:00
Alex Chen
7944aacafa
Feat: add gpustack model provider (#4469) 
### What problem does this PR solve?

Add GPUStack as a new model provider.
[GPUStack](https://github.com/gpustack/gpustack) is an open-source GPU
cluster manager for running LLMs. Currently, locally deployed models in
GPUStack cannot integrate well with RAGFlow. GPUStack provides both
OpenAI compatible APIs (Models / Chat Completions / Embeddings /
Speech2Text / TTS) and other APIs like Rerank. We would like to use
GPUStack as a model provider in ragflow.

[GPUStack Docs](https://docs.gpustack.ai/latest/quickstart/)

Related issue: https://github.com/infiniflow/ragflow/issues/4064.

### Type of change

- [x] New Feature (non-breaking change which adds functionality)



### Testing Instructions
1. Install GPUStack and deploy the `llama-3.2-1b-instruct` llm, `bge-m3`
text embedding model, `bge-reranker-v2-m3` rerank model,
`faster-whisper-medium` Speech-to-Text model, `cosyvoice-300m-sft` in
GPUStack.
2. Add provider in ragflow settings.
3. Testing in ragflow.
 2025-01-15 14:15:58 +08:00
Kevin Hu
e478586a8e
Refactor. (#4487) 
### What problem does this PR solve?

### Type of change

- [x] Refactoring
 2025-01-15 14:06:46 +08:00
Kevin Hu
f556f0239c
Fix dify retrieval issue. (#4473) 
### What problem does this PR solve?

#4464
#4469 

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-14 13:16:05 +08:00
Jin Hai
fd0bf3adf0
Format: dos2unix (#4467) 
### What problem does this PR solve?

Format the code

### Type of change

- [x] Refactoring

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2025-01-13 18:19:01 +08:00
Kevin Hu
e098fcf6ad
Fix csv for TAG. (#4454) 
### What problem does this PR solve?


### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-13 12:03:18 +08:00
Jin Hai
4dde73f897
Error message: Infinity not support table parsing method (#4439) 
### What problem does this PR solve?

Specific error message.

### Type of change

- [x] Refactoring

Signed-off-by: jinhai <haijin.chn@gmail.com>
 2025-01-10 16:39:13 +08:00
Kevin Hu
c5da3cdd97
Tagging (#4426) 
### What problem does this PR solve?

#4367

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
 2025-01-09 17:07:21 +08:00
Jin Hai
d64df4de9c
Update error message (#4417) 
### What problem does this PR solve?

1. Update error message
2. Remove space characters

### Type of change

- [x] Refactoring

---------

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2025-01-08 20:18:27 +08:00
Kevin Hu
d9a4e4cc3b
Fix page size error. (#4401) 
### What problem does this PR solve?

#4400

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-07 19:06:31 +08:00
Kevin Hu
b93c136797
Fix gemini embedding error. (#4356) 
### What problem does this PR solve?

#4314

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2025-01-06 14:41:29 +08:00
Kenny Dizi
bad764bcda
Improve storage engine (#4341) 
### What problem does this PR solve?

- Bring `STORAGE_IMPL` back in `rag/svr/cache_file_svr.py`
- Simplify storage connection when working with AWS S3

### Type of change

- [x] Refactoring
 2025-01-06 12:06:24 +08:00
Yingfeng
50f209204e
Synchronize with enterprise version (#4325) 
### Type of change

- [x] Refactoring
 2025-01-02 13:44:44 +08:00
Kevin Hu
0e5124ec99
Show the errors out. (#4305) 
### What problem does this PR solve?


### Type of change

- [x] Refactoring
 2024-12-31 15:32:02 +08:00
Kevin Hu
4ba4f622a5
Refactor (#4303) 
### What problem does this PR solve?

### Type of change
- [x] Refactoring
 2024-12-31 14:31:31 +08:00
Kevin Hu
8fb18f37f6
Code refactor. (#4291) 
### What problem does this PR solve?

### Type of change

- [x] Refactoring
 2024-12-30 18:38:51 +08:00
TeslaZY
dd13a5d05c
Fix some bugs in text2sql.(#4279)(#4281) (#4280) 
Fix some bugs in text2sql.(#4279)(#4281)

### What problem does this PR solve?
- The incorrect results in parsing CSV files of the QA knowledge base in
the text2sql scenario. Process CSV files using the csv library. Decouple
CSV parsing from TXT parsing
- Most llm return results in markdown format ```sql query ```, Fix
execution error caused by LLM output SQLmarkdown format.### Type of
change
- [x] Bug Fix (non-breaking change which fixes an issue)
 2024-12-30 10:32:19 +08:00
Kevin Hu
f948c0d9f1
Clean query. (#4259) 
### What problem does this PR solve?

#4239

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2024-12-27 14:25:03 +08:00
Jin Hai
722545e5e0
Fix bugs (#4241) 
### What problem does this PR solve?

1. Refactor error message
2. Fix knowledges are created on ES and can't be found in Infinity. The
document chunk fetch error.

### Type of change

- [x] Fix bug
- [x] Refactoring

---------

Signed-off-by: jinhai <haijin.chn@gmail.com>
 2024-12-26 16:08:17 +08:00
Kevin Hu
7e063283ba
Removing invisible chars before tokenization. (#4233) 
### What problem does this PR solve?

#4223

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
 2024-12-26 11:48:16 +08:00
Zhichang Yu
b7a7413419
Bump infinity to 0.5.2 (#4207) 
### What problem does this PR solve?

Bump infinity to 0.5.2

### Type of change

- [x] Refactoring
 2024-12-24 15:17:37 +08:00