Starstruk Logo MarkStarstruk

v1.10.0

Portkey-AI/gatewayv1.10.0Jun 25, 2025by VisargD

AI Summary

A major feature release introducing multiple new providers (Nscale, Hyperbolic AI, Featherless, Kluster AI) and significant Bedrock features including inference profiles and prompt caching.

Key Highlights

  • Support for Nscale provider
  • Inference profiles for Bedrock
  • Support for Hyperbolic AI and Featherless providers
  • Anthropic prompt caching for tool results
  • Support for Vertex AI global region endpoints

Breaking Changes

  • Rename 'Model Whitelist' to 'Allowed Models'

New Features

  • Nscale provider support
  • Hyperbolic AI provider support
  • Featherless provider support
  • Kluster AI support
  • Bedrock Inference Profiles
  • Anthropic Prompt Caching
  • Vertex AI Global Regions
  • Background mode parameter on OpenAI Responses API

Full Release Notes

## What's Changed
* provider: add Nscale provider by @tomukmatthews in https://github.com/Portkey-AI/gateway/pull/1087
* Add panw-prisma-airs plugin with tests and update config/index by @jroberts2600 in https://github.com/Portkey-AI/gateway/pull/1088
* add link to devin deepwiki by @vrushankportkey in https://github.com/Portkey-AI/gateway/pull/1109
* New Feature: Background mode param on OpenAI responses API by @siddharthsambharia-portkey in https://github.com/Portkey-AI/gateway/pull/1111
* Add seed param for Vertex AI and Google Gemini Provider by @siddharthsambharia-portkey in https://github.com/Portkey-AI/gateway/pull/1115
* support anthropic computer use by @narengogi in https://github.com/Portkey-AI/gateway/pull/1126
* fix multi turn tool calling for anthropic when arguments to the tool call is an empty object by @narengogi in https://github.com/Portkey-AI/gateway/pull/1104
* Fix panw-prisma-airs manifest.json to use proper JSON schema format by @jroberts2600 in https://github.com/Portkey-AI/gateway/pull/1128
* add feat. kluster_ai by @Ajay-Satish-01 in https://github.com/Portkey-AI/gateway/pull/1082
* provider: added support for Hyperbolic AI by @Utkarsh-0304 in https://github.com/Portkey-AI/gateway/pull/1108
* fix: support custom-host for azure plugin to support privatelink by @b4s36t4 in https://github.com/Portkey-AI/gateway/pull/1117
* fix thinking for gemini models by @narengogi in https://github.com/Portkey-AI/gateway/pull/1113
* feature: inference profiles for bedrock by @narengogi in https://github.com/Portkey-AI/gateway/pull/1118
* support service tier for groq by @narengogi in https://github.com/Portkey-AI/gateway/pull/1146
* assumed role support for bedrock application inference profile by @narengogi in https://github.com/Portkey-AI/gateway/pull/1131
* anthropic prompt caching for tool result and tool use by @narengogi in https://github.com/Portkey-AI/gateway/pull/1141
* fix: Exa guardrail by @vrushankportkey in https://github.com/Portkey-AI/gateway/pull/1150
* add featherless provider (access to 7900+ open source models) by @DarinVerheijke in https://github.com/Portkey-AI/gateway/pull/1138
* Add SUTRA Integration with Portkey – New Cookbook by @Shubhwithai in https://github.com/Portkey-AI/gateway/pull/1137
* return finish reason in bedrock error chunk by @narengogi in https://github.com/Portkey-AI/gateway/pull/1143
* feat: add required metadata keys plugin by @VisargD in https://github.com/Portkey-AI/gateway/pull/1147
* fix: index.html page example by @horochx in https://github.com/Portkey-AI/gateway/pull/1120
* Add request, response log for the Portkey PII plugin to the main requ… by @roh26it in https://github.com/Portkey-AI/gateway/pull/1052
* feat: support extra endpoints for azure-ai provider by @b4s36t4 in https://github.com/Portkey-AI/gateway/pull/1148
* fix: return error response for webhook non-timeout error by @b4s36t4 in https://github.com/Portkey-AI/gateway/pull/1167
* Chore/Fix-installation-guide-readme by @siddharthsambharia-portkey in https://github.com/Portkey-AI/gateway/pull/1170
* fix: Rename Model Whitelist to Allowed Models by @vrushankportkey in https://github.com/Portkey-AI/gateway/pull/1144
* feat: add support for vertex-ai global region endpoints by @VisargD in https://github.com/Portkey-AI/gateway/pull/1171
* improve strict openai compliance by @narengogi in https://github.com/Portkey-AI/gateway/pull/1165
* Revert "fix: Exa guardrail" by @VisargD in https://github.com/Portkey-AI/gateway/pull/1173
* feat: base integration for circuit breaker by @sk-portkey in https://github.com/Portkey-AI/gateway/pull/1163
* 1.10.0 by @VisargD in https://github.com/Portkey-AI/gateway/pull/1174

## New Contributors
* @tomukmatthews made their first contribution in https://github.com/Portkey-AI/gateway/pull/1087
* @jroberts2600 made their first contribution in https://github.com/Portkey-AI/gateway/pull/1088
* @Utkarsh-0304 made their first contribution in https://github.com/Portkey-AI/gateway/pull/1108
* @DarinVerheijke made their first contribution in https://github.com/Portkey-AI/gateway/pull/1138
* @Shubhwithai made their first contribution in https://github.com/Portkey-AI/gateway/pull/1137
* @horochx made their first contribution in https://github.com/Portkey-AI/gateway/pull/1120

**Full Changelog**: https://github.com/Portkey-AI/gateway/compare/v1.9.19...v1.10.0