update groq llm (#2103)

### What problem does this PR solve?

#2076   update groq llm.

### Type of change

- [x] New Feature (non-breaking change which adds functionality)

Co-authored-by: Zhedong Cen <cenzhedong2@126.com>
This commit is contained in:
黄腾 2024-08-27 11:42:00 +08:00 committed by GitHub
parent 88d52e335c
commit cf038e099f
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -906,6 +906,18 @@
"max_tokens": 8192, "max_tokens": 8192,
"model_type": "chat" "model_type": "chat"
}, },
{
"llm_name": "llama-3.1-70b-versatile",
"tags": "LLM,CHAT,128k",
"max_tokens": 131072,
"model_type": "chat"
},
{
"llm_name": "llama-3.1-8b-instant",
"tags": "LLM,CHAT,128k",
"max_tokens": 131072,
"model_type": "chat"
},
{ {
"llm_name": "mixtral-8x7b-32768", "llm_name": "mixtral-8x7b-32768",
"tags": "LLM,CHAT,5k", "tags": "LLM,CHAT,5k",