Starstruk Logo MarkStarstruk

v0.6.10

vllm-project/vllm-omniv0.6.10Feb 2, 2025by github-actions[bot]

AI Summary

This release adds support for advanced AI models like OpenAI o1 and Gemini 2.0, enhances Redis capabilities with Sentinel and Cluster support, and introduces new providers such as DeepSeek and Replicate.

Key Highlights

  • Support for OpenAI o1 model
  • Support for Gemini 2.0 Flash and Thinking models
  • Enhanced Redis support (Sentinel and Cluster)
  • Support for DeepSeek balance queries

New Features

  • Support replicate chat models
  • Add openai o1
  • Add gemini-2.0-flash-exp
  • Support Redis Sentinel and Redis Cluster
  • Add balance query support for DeepSeek
  • Support gpt-4o-2024-11-20

Full Release Notes

## What's Changed
* feat: support replicate chat models by @Laisky in https://github.com/songquanpeng/one-api/pull/1989
* feat: add openai o1 by @Laisky in https://github.com/songquanpeng/one-api/pull/1990
* feat: add gemini-2.0-flash-exp by @Laisky in https://github.com/songquanpeng/one-api/pull/1983
* chore(deps): bump golang.org/x/crypto from 0.24.0 to 0.31.0 by @dependabot in https://github.com/songquanpeng/one-api/pull/1976
* feat: update qwen model and price by @longkeyy in https://github.com/songquanpeng/one-api/pull/1966
* feat: enhance response handling to support gemini-2.0-thinking by @mxdlzg in https://github.com/songquanpeng/one-api/pull/1995
* fix: fix balance query for siliconflow by @Gk0Wk in https://github.com/songquanpeng/one-api/pull/1960
* docs: add tutorial section for BT Panel installation by @bestlaw66 in https://github.com/songquanpeng/one-api/pull/1985
* fix: remove the duplicate `claude-3-5-haiku-20241022` in Anthropic's base model list by @ZhangTianrong in https://github.com/songquanpeng/one-api/pull/1957
* feat: support Redis Sentinel and Redis Cluster by @lihangfu in https://github.com/songquanpeng/one-api/pull/1952
* feat: add balance query support for DeepSeek by @Gk0Wk in https://github.com/songquanpeng/one-api/pull/1946
* chore: update model mapping implementation for audio by @ibigbug in https://github.com/songquanpeng/one-api/pull/1932
* feat: support gpt-4o-2024-11-20 by @WqyJh in https://github.com/songquanpeng/one-api/pull/1941

## New Contributors
* @Gk0Wk made their first contribution in https://github.com/songquanpeng/one-api/pull/1960
* @bestlaw66 made their first contribution in https://github.com/songquanpeng/one-api/pull/1985
* @ZhangTianrong made their first contribution in https://github.com/songquanpeng/one-api/pull/1957
* @ibigbug made their first contribution in https://github.com/songquanpeng/one-api/pull/1932

**Full Changelog**: https://github.com/songquanpeng/one-api/compare/v0.6.9...v0.6.10