Starstruk Logo MarkStarstruk

v0.6.9

vllm-project/vllm-omniv0.6.9Dec 22, 2024by github-actions[bot]

AI Summary

The release focuses on expanding provider support with SiliconFlow, Groq, and xAI, while improving Ollama capabilities and adding critical features like OIDC authentication and multipart request support.

Key Highlights

  • Support for xAI (Grok)
  • Support for Claude Sonnet 3.5 v2 and Haiku
  • OIDC authentication support
  • Multipart/form-data request support

New Features

  • Add SiliconFlow
  • Update Ollama embedding API with multi-text support
  • Synchronize with Groq model official release
  • Support OIDC
  • Support SparkDesk-v3.1-128K and v3.5-32K
  • Support multipart/form-data format request
  • Support gzip decode

Full Release Notes

## What's Changed
* docs: update introduction for QChatGPT by @RockChinQ in https://github.com/songquanpeng/one-api/pull/1707
* feat: add SiliconFlow by @jackalcooper in https://github.com/songquanpeng/one-api/pull/1717
* feat: update Ollama embedding API to latest version with multi-text embedding support by @SLKun in https://github.com/songquanpeng/one-api/pull/1715
* feat: update gemini model by @longkeyy in https://github.com/songquanpeng/one-api/pull/1705
* feat: add Max Tokens and Context Window Setting Options for Ollama Channel by @MotorBottle in https://github.com/songquanpeng/one-api/pull/1694
* feat: synchronize with the official release of the groq model. by @longkeyy in https://github.com/songquanpeng/one-api/pull/1677
* fix: Groq organization not auto-disabled when blocked by @kaqijiang in https://github.com/songquanpeng/one-api/pull/1822
* fix: postgres use COALESCE replace null by @guogeer in https://github.com/songquanpeng/one-api/pull/1793
* feat: update disabled channel by @ye4293 in https://github.com/songquanpeng/one-api/pull/1780
* feat: ResponseFormat support json_schema by @majian159 in https://github.com/songquanpeng/one-api/pull/1759
* fix: fix ali embedding model always use v1 by @leavegee in https://github.com/songquanpeng/one-api/pull/1747
* feat: update stepfun's models by @forrestlinfeng in https://github.com/songquanpeng/one-api/pull/1740
* feat: add lobechat open link options by @MrChihiro in https://github.com/songquanpeng/one-api/pull/1741
* fix: getTokenById return token nil, make panic by @qinguoyi in https://github.com/songquanpeng/one-api/pull/1728
* feat: support new openai models (4o 0806, chatgpt-4o-latest) by @HynoR in https://github.com/songquanpeng/one-api/pull/1721
* feat: add oidc support by @Oniokey in https://github.com/songquanpeng/one-api/pull/1725
* feat: support SparkDesk-v3.1-128K by @lihangfu in https://github.com/songquanpeng/one-api/pull/1732
* feat: support siliconflow usage by @TimeTrapzz in https://github.com/songquanpeng/one-api/pull/1798
* fix: modify the type of token models to be text by @xuruidong in https://github.com/songquanpeng/one-api/pull/1761
* feat: support multipart/form-data format request by @bearslyricattack in https://github.com/songquanpeng/one-api/pull/1690
* feat: support SparkDesk-v3.5-32K by @lihangfu in https://github.com/songquanpeng/one-api/pull/1832
* fix：unsuccessful lobechat redirection link by @MrChihiro in https://github.com/songquanpeng/one-api/pull/1843
* feat: add Vertex AI gemini-1.5-pro-002 and gemini-1.5-flash-002 by @hellof20 in https://github.com/songquanpeng/one-api/pull/1854
* fix: use modelMap when testing a channel by @liangjs in https://github.com/songquanpeng/one-api/pull/1855
* feat: update groq model and price by @longkeyy in https://github.com/songquanpeng/one-api/pull/1864
* feat: add support for Claude Sonnet 3.5 v2 by @shaoyun in https://github.com/songquanpeng/one-api/pull/1888
* feat: update Gemini adaptor to support custom response format by @mxdlzg in https://github.com/songquanpeng/one-api/pull/1892
* feat: added support for Claude 3.5 Haiku by @shaoyun in https://github.com/songquanpeng/one-api/pull/1912
* feat: add support for xAI by @lwshen in https://github.com/songquanpeng/one-api/pull/1915
* feat: add new claude models by @Laisky in https://github.com/songquanpeng/one-api/pull/1910
* fix: changeoptional field to pointer type by @wanthigh in https://github.com/songquanpeng/one-api/pull/1907
* fix: update Spark Lite's domain to lite by @lihangfu in https://github.com/songquanpeng/one-api/pull/1896
* feat: support gzip decode by @Calcium-Ion in https://github.com/songquanpeng/one-api/pull/1962

## New Contributors
* @jackalcooper made their first contribution in https://github.com/songquanpeng/one-api/pull/1717
* @SLKun made their first contribution in https://github.com/songquanpeng/one-api/pull/1715
* @longkeyy made their first contribution in https://github.com/songquanpeng/one-api/pull/1705
* @MotorBottle made their first contribution in https://github.com/songquanpeng/one-api/pull/1694
* @kaqijiang made their first contribution in https://github.com/songquanpeng/one-api/pull/1822
* @guogeer made their first contribution in https://github.com/songquanpeng/one-api/pull/1793
* @leavegee made their first contribution in https://github.com/songquanpeng/one-api/pull/1747
* @forrestlinfeng made their first contribution in https://github.com/songquanpeng/one-api/pull/1740
* @MrChihiro made their first contribution in https://github.com/songquanpeng/one-api/pull/1741
* @qinguoyi made their first contribution in https://github.com/songquanpeng/one-api/pull/1728
* @Oniokey made their first contribution in https://github.com/songquanpeng/one-api/pull/1725
* @TimeTrapzz made their first contribution in https://github.com/songquanpeng/one-api/pull/1798
* @xuruidong made their first contribution in https://github.com/songquanpeng/one-api/pull/1761
* @bearslyricattack made their first contribution in https://github.com/songquanpeng/one-api/pull/1690
* @hellof20 made their first contribution in https://github.com/songquanpeng/one-api/pull/1854
* @liangjs made their first contribution in https://github.com/songquanpeng/one-api/pull/1855
* @lwshen made their first contribution in https://github.com/songquanpeng/one-api/pull/1915
* @wanthigh made their first contribution in https://github.com/songquanpeng/one-api/pull/1907

**Full Changelog**: https://github.com/songquanpeng/one-api/compare/v0.6.8...v0.6.9