Starstruk Logo MarkStarstruk

v1.4.0

higress-group/higressv1.4.0May 29, 2024by johnlanni

AI Summary

Focuses on AI proxy capabilities, introducing the core AI-Proxy Wasm plugin and supporting various AI models (Groq, Yi, Baichuan, DeepSeek, Ollama, ZhipuAI). Includes streaming body support.

Key Highlights

  • Core AI-Proxy Wasm plugin
  • Support for multiple AI models (Groq, Yi, Baichuan, DeepSeek, Ollama, ZhipuAI)
  • Wasm Go SDK support for streaming body processing
  • Automatic HTTPS
  • Enhanced Qwen stream event processing workflow

New Features

  • AI-Proxy Wasm plugin
  • Support for Groq AI model
  • Support for Yi AI model
  • Support for Baichuan LLM
  • Support for DeepSeek AI model
  • Support for Ollama AI model
  • Support for ZhipuAI provider

Full Release Notes

## What's Changed
* feat: Write the original host header before changed by Wasm plugin into access log by @CH3CHO in https://github.com/alibaba/higress/pull/920
* fix env var of ISTIO_GPRC_MAXRECVMSGSIZE by @johnlanni in https://github.com/alibaba/higress/pull/923
* fix: Refresh go.mod and go.sum file contents by @CH3CHO in https://github.com/alibaba/higress/pull/919
* Update README.md by @ctyytc in https://github.com/alibaba/higress/pull/909
* feature: add registry watcherStatus endpoint (#913) by @hanxiantao in https://github.com/alibaba/higress/pull/915
* Feature/add e2e testcase for issue 862 by @dongdongh233 in https://github.com/alibaba/higress/pull/899
* feat:add higress automatic https by @2456868764 in https://github.com/alibaba/higress/pull/854
* feat: Wasm go sdk support process streaming body by @johnlanni in https://github.com/alibaba/higress/pull/933
* Support multi ontick by @rinfx in https://github.com/alibaba/higress/pull/932
* feat: Add an AI-Proxy Wasm plugin by @CH3CHO in https://github.com/alibaba/higress/pull/921
* fix: when multiple http2Rpc config constructHttp2RpcEnvoyFilter (… by @hanxiantao in https://github.com/alibaba/higress/pull/935
* feat: Refactor Qwen stream event processing workflow by @CH3CHO in https://github.com/alibaba/higress/pull/939
* fix: Add "protocol" field into the readme of ai-proxy by @CH3CHO in https://github.com/alibaba/higress/pull/942
* waf skip body when protocol is grpc, websocket or sse by @rinfx in https://github.com/alibaba/higress/pull/943
* feat: Improve model parsing function of "hgctl plugin build" command by @CH3CHO in https://github.com/alibaba/higress/pull/966
* feat: support groq ai model by @cr7258 in https://github.com/alibaba/higress/pull/967
* fix mcp destination bug by @johnlanni in https://github.com/alibaba/higress/pull/968
* optimize rds cache by @johnlanni in https://github.com/alibaba/higress/pull/970
* support redis call by @johnlanni in https://github.com/alibaba/higress/pull/971
* Add proxy start script by @johnlanni in https://github.com/alibaba/higress/pull/972
* rel: Release v1.4.0-rc.1 by @johnlanni in https://github.com/alibaba/higress/pull/973
* feat: support yi ai model by @Chi-Kai in https://github.com/alibaba/higress/pull/980
* fix proxy wasm 0_2_100 by @johnlanni in https://github.com/alibaba/higress/pull/984
* keep bootstrap same with istio-ingress-gateway by @johnlanni in https://github.com/alibaba/higress/pull/986
* optimize default action of route envoyfilter by @johnlanni in https://github.com/alibaba/higress/pull/985
* feat: add baichuan llm support by @lizzy-0323 in https://github.com/alibaba/higress/pull/979
* feat: Enhance the feature of ai-proxy plugin by @CH3CHO in https://github.com/alibaba/higress/pull/976
* fix transformer plugin by @johnlanni in https://github.com/alibaba/higress/pull/990
* feat: support deepseek ai model by @goooogoooo in https://github.com/alibaba/higress/pull/989
* fix: Fix the incorrect usage of DisableReroute by @CH3CHO in https://github.com/alibaba/higress/pull/991
* feat: run the specific e2e test with environment variable by @Ink-33 in https://github.com/alibaba/higress/pull/975
* Fix the issue with multiple system prompts when using qwen-long file id mode. by @johnlanni in https://github.com/alibaba/higress/pull/994
* Fixed the issue where an empty string system prompt would be set when enabling file id. by @johnlanni in https://github.com/alibaba/higress/pull/999
* fix wasm recover by @johnlanni in https://github.com/alibaba/higress/pull/1003
* fix istio virtualserver merge by @johnlanni in https://github.com/alibaba/higress/pull/1006
* feat: support ollama ai model by @Claire-w in https://github.com/alibaba/higress/pull/1001
* feat: Add the ZhipuAI (ChatGLM) provider to the ai-proxy wasm plugin #950 by @Suchun-sv in https://github.com/alibaba/higress/pull/1007
* optimize mcp cds by @johnlanni in https://github.com/alibaba/higress/pull/1013
* add ai cache plugin by @johnlanni in https://github.com/alibaba/higress/pull/1010
* rel: Release v1.4.0 by @johnlanni in https://github.com/alibaba/higress/pull/1014

## New Contributors
* @ctyytc made their first contribution in https://github.com/alibaba/higress/pull/909
* @hanxiantao made their first contribution in https://github.com/alibaba/higress/pull/915
* @Chi-Kai made their first contribution in https://github.com/alibaba/higress/pull/980
* @lizzy-0323 made their first contribution in https://github.com/alibaba/higress/pull/979
* @goooogoooo made their first contribution in https://github.com/alibaba/higress/pull/989
* @Claire-w made their first contribution in https://github.com/alibaba/higress/pull/1001
* @Suchun-sv made their first contribution in https://github.com/alibaba/higress/pull/1007

**Full Changelog**: https://github.com/alibaba/higress/compare/v1.3.6...v1.4.0