Starstruk Logo MarkStarstruk

v1.9.11

Portkey-AI/gatewayv1.9.11Mar 22, 2025by VisargD

AI Summary

This update focuses on stability and feature expansion for Bedrock and Anthropic, including KMS support, guardrail improvements, and caching capabilities.

Key Highlights

  • KMS key support for Bedrock put requests
  • Default guardrails support
  • Image URL support for Anthropic and Vertex Anthropic
  • Cached streaming in grounding requests
  • Bedrock job ID and ARN handling

New Features

  • KMS key support
  • Default guardrails
  • Image URL support
  • Cached streaming
  • Bedrock job ID/ARN handling
  • Null content handling for tool use

Full Release Notes

## What's Changed
* fix: use bedrock job_id and job_arn for response by @b4s36t4 in https://github.com/Portkey-AI/gateway/pull/958
* docs: add ec2 quicklaunch cloudformation template by @code-crusher in https://github.com/Portkey-AI/gateway/pull/978
* Add labels parameter in Vertex AI by @elentaure in https://github.com/Portkey-AI/gateway/pull/984
* fix: logging error with more than 1k characters by @urbanonymous in https://github.com/Portkey-AI/gateway/pull/970
* fix: bedrock guardrail handling update by @b4s36t4 in https://github.com/Portkey-AI/gateway/pull/990
* chore: vertex finetune and batches cleanup by @b4s36t4 in https://github.com/Portkey-AI/gateway/pull/989
* feat: kms key support for put requests in bedrock by @narengogi in https://github.com/Portkey-AI/gateway/pull/977
* handle thinking messages for anthropic by @narengogi in https://github.com/Portkey-AI/gateway/pull/987
* fix: remove conditional for bedrock list/get endpoints, date fixes by @b4s36t4 in https://github.com/Portkey-AI/gateway/pull/993
* Providers/ncompass by @vineye25 in https://github.com/Portkey-AI/gateway/pull/983
* fix: handle null content for tool use assistant message for bedrock by @VisargD in https://github.com/Portkey-AI/gateway/pull/992
* fix: add handling to detect all errors in retry handler by @VisargD in https://github.com/Portkey-AI/gateway/pull/991
* feat: add support for default guardrails by @VisargD in https://github.com/Portkey-AI/gateway/pull/986
* support passing image url for anthropic and vertex anthropic by @narengogi in https://github.com/Portkey-AI/gateway/pull/976
* support search mode param from pplx by @narengogi in https://github.com/Portkey-AI/gateway/pull/998
* changes to support cached streaming in grounding requests by @narengogi in https://github.com/Portkey-AI/gateway/pull/994
* 1.9.11 by @VisargD in https://github.com/Portkey-AI/gateway/pull/999

## New Contributors
* @code-crusher made their first contribution in https://github.com/Portkey-AI/gateway/pull/978
* @urbanonymous made their first contribution in https://github.com/Portkey-AI/gateway/pull/970
* @vineye25 made their first contribution in https://github.com/Portkey-AI/gateway/pull/983

**Full Changelog**: https://github.com/Portkey-AI/gateway/compare/v1.9.10...v1.9.11