Yongteng Lei
cdcaae17c6
Feat: add VLLM ( #5380 )
...
### What problem does this PR solve?
Read to add VLMM.
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-02-26 16:04:53 +08:00
Kevin Hu
96e9d50060
Let parallism of RAPTOR controlable. ( #5379 )
...
### What problem does this PR solve?
#4874
### Type of change
- [x] Refactoring
2025-02-26 15:58:06 +08:00
Kevin Hu
4f40f685d9
Code refactor ( #5371 )
...
### What problem does this PR solve?
#5173
### Type of change
- [x] Refactoring
2025-02-26 15:40:52 +08:00
Zhichang Yu
ffb4cda475
Run keyword_extraction, question_proposal, content_tagging in thread pool ( #5376 )
...
### What problem does this PR solve?
Run keyword_extraction, question_proposal, content_tagging in threads
### Type of change
- [x] Performance Improvement
2025-02-26 15:21:14 +08:00
Kevin Hu
4e2afcd3b8
Fix FlagRerank max_length issue. ( #5366 )
...
### What problem does this PR solve?
#5352
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-26 11:01:13 +08:00
Kevin Hu
53b9e7b52f
Add tavily as web searh tool. ( #5349 )
...
### What problem does this PR solve?
#5198
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-02-26 10:21:04 +08:00
Kevin Hu
955801db2e
Resolve super class invokation error. ( #5337 )
...
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-25 17:42:29 +08:00
Kevin Hu
daddfc9e1b
Remove dup gb2312, solve currupt error. ( #5326 )
...
### What problem does this PR solve?
#5252
#5325
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-25 12:22:37 +08:00
Zhichang Yu
db42d0e0ae
Optimize ocr ( #5297 )
...
### What problem does this PR solve?
Introduced OCR.recognize_batch
### Type of change
- [x] Performance Improvement
2025-02-24 16:21:55 +08:00
Kevin Hu
df3d0f61bd
Fix base url missing for deepseek from Tongyi. ( #5294 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-24 15:43:32 +08:00
Kevin Hu
ec96426c00
Tongyi adapts deepseek. ( #5285 )
...
### What problem does this PR solve?
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-02-24 14:04:25 +08:00
Kevin Hu
9aa222f738
Let list_chat go without kb checking. ( #5280 )
...
### What problem does this PR solve?
#5278
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-24 13:21:05 +08:00
liwenju0
569e40544d
Refactor rerank model with dynamic batch processing and memory manage… ( #5273 )
...
…ment
### What problem does this PR solve?
Issue:https://github.com/infiniflow/ragflow/issues/5262
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
Co-authored-by: wenju.li <wenju.li@deepctr.cn>
2025-02-24 11:32:08 +08:00
Omar Leonardo Sanchez Granados
4f2816c01c
Add support to boto3 default connection ( #5246 )
...
### What problem does this PR solve?
This pull request includes changes to the initialization logic of the
`ChatModel` and `EmbeddingModel` classes to enhance the handling of AWS
credentials.
Use cases:
- Use env variables for credentials instead of managing them on the DB
- Easy connection when deploying on an AWS machine
### Type of change
- [X] New Feature (non-breaking change which adds functionality)
2025-02-24 11:01:14 +08:00
yrk111222
7ce675030b
Support downloading models from ModelScope Community. ( #5073 )
...
This PR supports downloading models from ModelScope. The main
modifications are as follows:
-New Feature (non-breaking change which adds functionality)
-Documentation Update
---------
Co-authored-by: Kevin Hu <kevinhu.sh@gmail.com>
2025-02-24 10:12:20 +08:00
Zhichang Yu
d78010c376
Fixed similarity on infinity ( #5236 )
...
### What problem does this PR solve?
Fixed similarity on infinity
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-21 18:50:54 +08:00
Kevin Hu
3444cb15e3
Refine search query. ( #5235 )
...
### What problem does this PR solve?
#5173
#5214
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-21 18:32:32 +08:00
Kevin Hu
cdb3e6434a
Fix empty question issue. ( #5225 )
...
### What problem does this PR solve?
#5241
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-21 15:47:39 +08:00
Kevin Hu
1a755e75c5
Remove v1 ( #5220 )
...
### What problem does this PR solve?
#5201
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-21 15:15:38 +08:00
Kevin Hu
7b3d700d5f
Apply agentic searching. ( #5196 )
...
### What problem does this PR solve?
#5173
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-02-20 17:41:01 +08:00
Kevin Hu
e6c024f8bf
Fix too many clause while searching. ( #5119 )
...
### What problem does this PR solve?
#5100
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-19 13:18:39 +08:00
Kevin Hu
c28bc41a96
Fix docx table issue. ( #5117 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-19 12:40:06 +08:00
ubbg
29a59ed7e2
Fix: Use self.dataStore.indexExist in all_tags method of Dealer ( #5108 )
...
### What problem does this PR solve?
This PR fixes an AttributeError in the all_tags method of the Dealer
class. Previously, the method incorrectly called
self.docStoreConn.indexExist instead of self.dataStore.indexExist. Since
self.docStoreConn was never set (and self.dataStore is already
initialized in init), this resulted in an error when attempting to check
if the index exists. This change ensures that the proper connector is
used for the index existence check, thereby resolving the issue._
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-19 11:50:57 +08:00
Kevin Hu
9ff825f39d
Ignore exceptions when no index ahead. ( #5047 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2025-02-18 09:09:22 +08:00
Kevin Hu
3aa5c2a699
Ignore exception of empty index. ( #5030 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2025-02-17 15:59:55 +08:00
saikidev
d2929e432e
Feat: add LLM provider PPIO ( #5013 )
...
### What problem does this PR solve?
Add a LLM provider: PPIO
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
- [x] Documentation Update
2025-02-17 12:03:26 +08:00
Kevin Hu
29ceeba95f
Fix hit cache error while raptoring. ( #4955 )
...
### What problem does this PR solve?
#4126
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-14 12:00:19 +08:00
Kevin Hu
b08bb56f6c
Display thinking for deepseek r1 ( #4904 )
...
### What problem does this PR solve?
#4903
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-02-12 15:43:13 +08:00
Mathias Panzenböck
9bcccadebd
Remove use of eval() from search.py ( #4887 )
...
Use `json.loads()` instead.
### What problem does this PR solve?
Using `eval()` can lead to code injections. I think this loads a JSON
field, right? If yes, why is this done via `eval()` and not
`json.loads()`?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-12 13:15:38 +08:00
Kevin Hu
0d3ed37b48
Make the update script shorter. ( #4854 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-10 18:18:49 +08:00
Kevin Hu
f374dd38b6
Fix divided by zero issue. ( #4784 )
...
### What problem does this PR solve?
#4779
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-08 10:36:26 +08:00
Kevin Hu
2aa0cdde8f
Fix Gemini chat issue. ( #4757 )
...
### What problem does this PR solve?
#4753
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-07 12:00:19 +08:00
Kevin Hu
448fa1c4d4
Robust for abnormal response from LLMs. ( #4747 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-06 17:34:53 +08:00
Kevin Hu
6f2c3a3c3c
Fix too long query exception. ( #4729 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-02-06 10:11:52 +08:00
Kevin Hu
283d036cba
Fitin for infinity. ( #4722 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2025-02-05 16:47:05 +08:00
Kyle
036f37a627
fix: err object has no attribute 'iter_lines' ( #4686 )
...
### What problem does this PR solve?
ERROR: 'Stream' object has no attribute 'iter_lines' with reference to
Claude/Anthropic chat streams
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
Co-authored-by: Kyle Olmstead <k.olmstead@offensive-security.com>
2025-02-01 22:39:30 +08:00
Kevin Hu
c354239b79
Make infinity adapt to condition exist
. ( #4657 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-26 18:45:36 +08:00
Kevin Hu
4776fa5e4e
Refactor for total_tokens. ( #4652 )
...
### What problem does this PR solve?
#4567
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-26 13:54:26 +08:00
Kevin Hu
c24137bd11
Fix too long integer for Table
. ( #4651 )
...
### What problem does this PR solve?
#4594
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-26 12:54:58 +08:00
Kevin Hu
4011c8f68c
Fix potential error. ( #4650 )
...
### What problem does this PR solve?
#4622
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-26 12:38:32 +08:00
writinwaters
2cb8edc42c
Added GPUStack ( #4649 )
...
### What problem does this PR solve?
### Type of change
- [x] Documentation Update
2025-01-26 12:25:02 +08:00
Kevin Hu
530b0dab17
Make infinity able to cal embedding sim only. ( #4644 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-26 10:29:52 +08:00
Kevin Hu
71c132f76d
Make infinity adapt ( #4635 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-24 17:45:04 +08:00
Kevin Hu
9d717f0b6e
Fix csv reader exception. ( #4628 )
...
### What problem does this PR solve?
#4552
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-24 14:47:19 +08:00
Kevin Hu
f1d9f4290e
Fix TogetherAIEmbed. ( #4623 )
...
### What problem does this PR solve?
#4567
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-24 10:29:30 +08:00
Kevin Hu
55f2b7c4d5
Code format. ( #4611 )
...
### What problem does this PR solve?
### Type of change
- [x] Refactoring
2025-01-23 18:43:32 +08:00
Kevin Hu
86892959a0
Rebuild graph when it's out of time. ( #4607 )
...
### What problem does this PR solve?
#4543
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Refactoring
2025-01-23 17:26:20 +08:00
Kevin Hu
13f04b7cca
Fix pdf applying Q&A issue. ( #4599 )
...
### What problem does this PR solve?
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2025-01-23 12:30:46 +08:00
Kevin Hu
dd0ebbea35
Light GraphRAG ( #4585 )
...
### What problem does this PR solve?
#4543
### Type of change
- [x] New Feature (non-breaking change which adds functionality)
2025-01-22 19:43:14 +08:00
Jin Hai
3894de895b
Update comments ( #4569 )
...
### What problem does this PR solve?
Add license statement.
### Type of change
- [x] Refactoring
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2025-01-21 20:52:28 +08:00