Kevin Hu 5e7c1fb23a
reduce rerank batch size (#2801)
### What problem does this PR solve?

### Type of change


- [x] Performance Improvement
2024-10-11 11:29:19 +08:00
..
2024-10-11 11:29:19 +08:00
2024-10-11 09:55:27 +08:00
2024-01-17 09:43:27 +08:00
2024-10-11 09:55:27 +08:00
2024-10-08 15:58:14 +08:00
2024-09-29 18:24:24 +08:00