Starstruk Logo MarkStarstruk

v2.0.5

higress-group/higressv2.0.5Jan 15, 2025by johnlanni

AI Summary

This update focuses on expanding AI capabilities with new embedding providers (OpenAI, Cohere) and providers (Together AI), alongside performance optimizations for AI proxy and Redis caching.

Key Highlights

  • Added support for OpenAI and Cohere embedding models in ai-cache.
  • Added Together AI support for ai-proxy.
  • Enhanced AI intent plugin and AI observability capabilities.
  • Optimized AI proxy and Redis wrapper support.

New Features

  • OpenAI embedding support
  • Cohere embedding support for ai-cache
  • Together AI support for ai-proxy
  • AI intent plugin enhancement
  • AI observability upgrade
  • Redis wrapper lazy init and database options support

Full Release Notes

## What's Changed
* bugfix and extend ai log by @rinfx in https://github.com/alibaba/higress/pull/1576
* Support OpenAI embedding. by @duxin40 in https://github.com/alibaba/higress/pull/1542
* docs: fix typos in ai-quota document by @mirror58229 in https://github.com/alibaba/higress/pull/1589
* fix: default port of static service in ai-cache plugin by @mirror58229 in https://github.com/alibaba/higress/pull/1591
* feat: support choosing chatCompletionV2 or chatCompletionPro API for minimax provider by @hanxiantao in https://github.com/alibaba/higress/pull/1593
* AI observability upgrade by @rinfx in https://github.com/alibaba/higress/pull/1587
* AI proxy return unified status in header phase by @StarryVae in https://github.com/alibaba/higress/pull/1588
* qwen bailian compatible bug fix by @rinfx in https://github.com/alibaba/higress/pull/1597
* bugfix: cannot parse content if one streaming body has multi chunks by @rinfx in https://github.com/alibaba/higress/pull/1606
* optimize ai proxy by @johnlanni in https://github.com/alibaba/higress/pull/1603
* redis wrapper support lazy init and database options by @johnlanni in https://github.com/alibaba/higress/pull/1602
* Enhance the capabilities of the AI Intent plugin by @007gzs in https://github.com/alibaba/higress/pull/1605
* feat: ai-proxy wasm plugin support Together AI by @VinciWu557 in https://github.com/alibaba/higress/pull/1617
* feat: Support setting gateway.unprivilegedPortSupported manually by @CH3CHO in https://github.com/alibaba/higress/pull/1616
* fix: Make opa listen to all IPs by @CH3CHO in https://github.com/alibaba/higress/pull/1621
* feat: retry failed request by @cr7258 in https://github.com/alibaba/higress/pull/1590
* move oidcHandler from global to pluginconfig by @rinfx in https://github.com/alibaba/higress/pull/1601
* optimize ai cache by @johnlanni in https://github.com/alibaba/higress/pull/1626
* Add cohere embedding for ai-cache by @ayanami-desu in https://github.com/alibaba/higress/pull/1572
* feat: support github provider for oidc wasm plugin by @Jing-ze in https://github.com/alibaba/higress/pull/1639
* fix: Enlarge the default retry timeout in ai-proxy by @CH3CHO in https://github.com/alibaba/higress/pull/1640
* ai-cache update body buffer limit size by @johnlanni in https://github.com/alibaba/higress/pull/1644
* fix ai proxy checkStream by @johnlanni in https://github.com/alibaba/higress/pull/1645
* Release 2.0.5 by @johnlanni in https://github.com/alibaba/higress/pull/1646

## New Contributors
* @duxin40 made their first contribution in https://github.com/alibaba/higress/pull/1542
* @mirror58229 made their first contribution in https://github.com/alibaba/higress/pull/1589
* @StarryVae made their first contribution in https://github.com/alibaba/higress/pull/1588
* @VinciWu557 made their first contribution in https://github.com/alibaba/higress/pull/1617
* @ayanami-desu made their first contribution in https://github.com/alibaba/higress/pull/1572

**Full Changelog**: https://github.com/alibaba/higress/compare/v2.0.4...v2.0.5