16 Commits

Author	SHA1	Message	Date
takatost	2eba98a465	feat: optimize anthropic connection pool (#1066)	2023-08-31 16:18:59 +08:00
takatost	417c19577a	feat: add LocalAI local embedding model support (#1021) ... Co-authored-by: StyleZhang <jasonapring2015@outlook.com>	2023-08-29 22:22:02 +08:00
takatost	0796791de5	feat: hf inference endpoint stream support (#1028)	2023-08-26 19:48:34 +08:00
takatost	2c30d19cbe	feat: add baichuan prompt (#985)	2023-08-24 10:22:36 +08:00
takatost	a76fde3d23	feat: optimize hf inference endpoint (#975)	2023-08-23 19:47:50 +08:00
takatost	e0a48c4972	fix: xinference chat support (#939)	2023-08-21 20:44:29 +08:00
takatost	6c832ee328	fix: remove openllm pypi package because of this package too large (#931)	2023-08-21 02:12:28 +08:00
takatost	3ea8d7a019	feat: add openllm support (#928)	2023-08-20 19:04:33 +08:00
takatost	da3f10a55e	feat: server xinference support (#927)	2023-08-20 17:46:41 +08:00
takatost	0a0d63457d	feat: record price unit in messages (#919)	2023-08-19 18:51:40 +08:00
Krasus.Chen	fd0fc8f4fe	Fix/price calc (#862)	2023-08-19 16:41:35 +08:00
takatost	2a27dad2fb	fix: run model serval ex not return (#915)	2023-08-19 14:16:41 +08:00
takatost	9adbeadeec	feat: claude paid optimize (#890)	2023-08-17 16:56:20 +08:00
takatost	f42e7d1a61	feat: add spark v2 support (#885)	2023-08-17 15:08:57 +08:00
takatost	7898937eae	feat: optimize message return (#822)	2023-08-13 13:51:12 +08:00
takatost	5fa2161b05	feat: server multi models support (#799)	2023-08-12 00:57:00 +08:00