transports/v2.2.0
maximhq/bifrosttransports/v2.2.0Sep 15, 2026by akshaydeo
Upgrading?
AI Summary
Bifrost HTTP Transport v2.2.0 adds marketplace support for Claude Desktop and Cowork, introduces time-of-day peak/off-peak pricing, and achieves GA status for realtime transcription. It also enhances governance, MCP tool handling, and plugin compatibility.
Key Highlights
- Claude Desktop and Cowork Marketplace support via Git repository cloning
- Time-of-Day Peak and Off-Peak Pricing for usage-based models
- GA Realtime Transcription sessions over WebSocket and WebRTC
- Governance entity names now stored in MCP tool logs
- Regex Model Allow and Block Lists for provider and virtual keys
New Features
- New `/api/skills/serve/claude-code.git` endpoint for marketplace skills
- Bedrock OpenAI-Compatible Endpoint Routing via `use_openai_endpoints` flag
- Anthropic Tool Search support on Bedrock Claude models
- Namespace Tool Support across providers to prevent collisions
- Trusted Networks for SSRF guard outbound discovery
- Prompt Cache Reload through ServerCallbacks for multi-node deployments
- Guardrail Tool-Call Argument Redaction
- Regions and Service URLs displayed in plaintext in UI
- Pinnable Log Search Mode for better request ID handling
- MCP Usage Guide Auth Methods (OAuth, Identity Provider, Virtual Key)
- Chart Color System for light and dark themes
Full Release Notes
## Bifrost HTTP Transport Release v2.2.0
## ✨ Features
- **Claude Desktop and Cowork Marketplace** - Skills stored in Bifrost can now be registered as a marketplace in Claude Desktop and Cowork, which reject the direct JSON URL and require a cloneable Git repository URL. A new `/api/skills/serve/claude-code.git` endpoint implements the two Git smart-HTTP requests used during a clone and serves a repository containing `.claude-plugin/marketplace.json`; the existing Claude Code flow is unchanged (#7152)
- **Time-of-Day Peak and Off-Peak Pricing** - Model pricing accepts `off_peak_cost_multiplier` and a `peak_hours` weekly schedule, so providers like DeepSeek that bill the same model at two rates are costed correctly. Base rates are treated as peak; the multiplier scales usage-based charges outside the declared windows. Flat per-request fees, per-search-query fees and guardrail/MCP `AdditionalCost` are never discounted. Windows use IANA timezones, weekday numbers and half-open `HH:MM` intervals that may wrap past midnight, and both fields are editable from the custom pricing override sheet (#6574, #6575, #6576, #6577, #6578, #6579, #7054)
- **GA Realtime Transcription** - OpenAI and Azure GA transcription sessions are served over both WebSocket and WebRTC with normal Bifrost authentication, routing, governance, guardrails, logging and transcription-aware pricing. These sessions carry only `intent=transcription` on the connection and deliver the routing model later in `session.update` (or in the initial multipart `/v1/realtime/calls` request for WebRTC), so Bifrost now routes on the nested transcription model while preserving realtime connection and turn semantics (#7089)
- **Regex Model Allow and Block Lists** - `allowed_models` / `blacklisted_models` on virtual keys and `models` / `blacklisted_models` on provider keys accept `regex:<pattern>` entries next to exact names. Patterns are compiled once as case-insensitive full matches, a pattern that is empty, `*` or does not compile is refused with 400, and list-models never surfaces a pattern as a model. Provider-key create and update now validate `models` the same way as `blacklisted_models`. This supersedes the separate `*_patterns` fields, which were added and then withdrawn before release (#6987, #6988, #6989, #6990, #7031, #7133, #7134)
- **Governance Entity Names on MCP Tool Logs** - `mcp_tool_logs` gains the same attribution shape the `logs` table has: `user_name`, `team_name`, `customer_name` and `business_unit_name` become real columns instead of transients, the multi-valued `team_ids`/`team_names`, `customer_ids`/`customer_names` and `business_unit_ids`/`business_unit_names` sets are stored as index-aligned JSON arrays, and `budget_ids` and `rate_limit_ids` are recorded. Names are written from the request context at ingestion, with nothing resolved on read, so the dashboard stops rendering raw UUIDs (#7154)
- **Endpoint-Attributed MCP Inspections** - Inspected MCP tool calls are logged with bounded identity sourced from the gateway rather than payload-supplied headers. A new `MCPObservation` carries device, app key, server label, tool name and decision onto both the pending and final log entry, and the MCP logs view falls back to `app_key` when `app` is absent so endpoint-attributed rows show the right app icon and name (#6959)
- **Virtual MCP References by Name** - Access profiles and governance projects reference Virtual MCPs through `virtual_mcp_name`, making config files portable across environments; names resolve on startup and a name matching nothing is refused. `mcp_configs` (`{ mcp_client_id, tools_to_execute }`) replaces the `mcp_servers` / `mcp_tool_overrides` include-exclude model with a single allowlist, where `["*"]` grants all tools including future ones and `[]` grants none. `virtual_mcp_id` and the old keys are deprecated, still accepted, and folded into the new shape at load time (#7181)
- **Normalized `error_type` Metric Label** - `bifrost_error_requests_total` gains an `error_type` label with a closed, prefix-structured vocabulary (`caller_*`, `policy_*`, `provider_*`, `bifrost_*`, `_OTHER`) so a 429 from a governance rate limit is distinguishable from a 429 from an upstream, and a 503 Bifrost shed under queue pressure from an upstream overload. Classification resolves a declared `ExtraFields.ErrorType` first, then Bifrost's own markers, then the status code; it deliberately ignores provider `error.type` strings, which disagree across providers for the same condition (#7141)
- **Bedrock OpenAI-Compatible Endpoint Routing** - A `use_openai_endpoints` flag on Bedrock keys and aliases routes chat completions and responses through Bedrock's `/openai/v1` surface instead of Converse, for models that support it. It is opt-in by design: Converse carries Bedrock Guardrails, `performanceConfig` and `requestMetadata` that the OpenAI-compatible surface silently ignores, so diverting automatically could stop a guardrail from being enforced with no visible error. The alias value wins over the key, matching `use_anthropic_endpoints` precedence (#7071, #7073)
- **Anthropic Tool Search on Bedrock Claude** - Anthropic tool search (`tool_search_tool_*`, `defer_loading`) is served on `bedrock/` Claude models by routing those requests to InvokeModel / InvokeModelWithResponseStream, the only Bedrock API AWS allows it on; CountTokens counts such requests with the same InvokeModel body. Server-side tool search also survives the Bedrock-native invoke ingress end to end: the tool is carried as an ingress-only marker so the egress predicate can see it, results are returned as a `server_tool_use` plus `tool_search_tool_result` pair rather than a client `tool_use` (which the API rejects when echoed back), the streaming path emits the same pair, replayed blocks round-trip unchanged, and the Anthropic-native response path carries them too (#6900, #6908, #7162, #7163, #7164, #7165, #7166)
- **Namespace Tool Support Across Providers** - Responses `namespace` tools are flattened in core for every provider whose wire lacks the type, with nested functions renamed to `<namespace>__<function>` so two namespaces sharing a function name no longer collide into an upstream `Tool names must be unique` 400. Returned `function_call` items map back to the bare name plus namespace, prior-turn calls and `tool_choice` names are re-aliased, and a still-duplicate name is rejected with a clear 400 before reaching the provider. Flattened names honour each wire's documented tool-name limit, overridable per model through `tool_name_max_length`. The names a provider reserves for its own server tools come from the datasheet row `reserved_tool_namespaces`, and Codex's literal `functions` namespace is unwrapped to top-level tools for every provider (#7039, #7082, #7084, #7161)
- **Trusted Networks for the SSRF Guard** - A `trusted_networks` list of IP/CIDR entries the SSRF guard consults before outbound discovery calls, so a self-hosted IdP on an internal network can be reached by the generic provider's discover-endpoints and discover-claims flows. Declaring the key in `config.json` makes it own the whole list, an explicit empty array clears dashboard-added entries, and omitting it leaves the stored allowlist untouched. Hostnames are refused, since DNS would then decide which requests bypass SSRF protection (#7081)
- **Prompt Cache Reload Through the Server** - `ReloadPromptCache` moves onto `ServerCallbacks` so enterprise can gossip it across nodes. The prompts plugin's in-memory index was previously rebuilt only in the process that served the write, so on a multi-node deployment a prompt published on node A left node B resolving `x-bf-prompt-id` / `x-bf-prompt-version` against a stale index until restart: an unknown version errored and `latest` served the old content. OSS behaviour is unchanged (#7061)
- **Guardrail Tool-Call Argument Redaction** - Guardrail redaction covers LLM tool-call arguments (Chat function arguments, Responses function arguments and custom-tool input) across the Anthropic streaming and non-streaming paths, reading and writing `delta.partial_json` on `input_json_delta` events and collecting string-valued paths inside a `tool_use` block's `input` without touching tool names, IDs or definitions. A separate identity-based transformer path lets provider-managed rewrites (Model Armor, Bedrock) land in the correct native JSON field even when the same text appears in several fields, verifying `Original` before patching and the written value after (#6977, #7049)
- **Regions and Service URLs in Plaintext** - Regions and service URLs (Azure endpoint, Vertex/Bedrock/Bedrock Mantle region, vLLM/Ollama/SGL/Databricks URL, MCP connection string) are public identifiers, not credentials, and were being unconditionally redacted into unreadable values in the UI. A new `SecretVar.RedactedIfSecret()` returns a plain clone for a literal value and still masks anything sourced from an env var or vault reference (#7085)
- **`wait_for_usage` for Custom Providers** - A `wait_for_usage` flag on `custom_provider_config` tells Bifrost the upstream sends a trailing usage-only frame, so the read loop holds open past `finish_reason` until it arrives instead of synthesizing a zero-usage terminal chunk. Termination stays bounded by the usage chunk, two consecutive post-finish heartbeat comments, EOF, or `stream_idle_timeout_in_seconds` (#7187)
- **Pinnable Log Search Mode** - The logs search box gains a mode dropdown (Auto, Content, Request ID). Auto-detection treated UUID-shaped input as an ID lookup and everything else as a content scan, which breaks for request IDs that are not UUID-shaped and for UUID-shaped strings that should be searched as content. A pinned mode bypasses all sniffing and re-runs the current input immediately (#7149)
- **MCP Usage Guide Auth Methods** - The MCP usage guide generates client configs for Virtual key, OAuth and Identity provider authentication instead of requiring a virtual key for every config. Credential resolution is centralized in `buildMCPHeaders()`, so OAuth emits no headers, identity provider emits a `Bearer` placeholder, and virtual key keeps `x-bf-vk` (#7111)
- **Chart Color System** - Dashboard charts, status badges and components read a structured set of CSS custom properties instead of hard-coded hex values, so colors adapt correctly between light and dark themes. Tokens are grouped as semantic (hues 0 to 70 reserved so no category can look like an error), sequential, ordinal for percentile series, and categorical at matched chroma assigned by rank (#7113)
## 🐞 Fixed
- **Client Disconnect Not Cancelling Requests** - A client that closes its socket while Bifrost is still waiting on core (silent upstream header wait, retry backoff) now cancels the request. `ConvertToBifrostContext` starts a socket watcher that peeks the client connection every 500 ms with `MSG_PEEK` and cancels the context on FIN or RST, so upstream retries stop as soon as nobody is listening; previously fasthttp offered no per-request `Done` and a disconnect was only noticed when an SSE write failed. No-op on non-unix platforms and on in-memory test connections (#7035, #7106)
- **Silent Upstream Never Timed Out** - `default_request_timeout_in_seconds` now bounds the wait for response headers on streaming requests, and cancelling a request closes the upstream socket. Every fasthttp client runs through a Bifrost-owned `RoundTripper` that applies the client's read/write timeouts and the request context to the request write and the header wait, then lifts the socket deadline once headers are parsed so `stream_idle_timeout_in_seconds` remains the only bound on the body. An upstream that accepts the connection and never answers now fails with 504 `RequestTimedOut` and its fallbacks are used, instead of pinning the provider worker. Unary large-response downloads bound every body read the same way, gzip-encoded bodies are classified for large-response mode by decompressed size, and a mid-body connection drop is again reported as the retryable 502 completion-marker error instead of a generic unexpected EOF (#7034, #7104)
- **Retry Storm After Client Disconnect** - fasthttp-level stale-connection retries no longer multiply `max_retries`. `contextTransport.RoundTrip` reports a pre-header failure on a freshly dialed socket with `retry=false`, so `StaleConnectionRetryIfErr` only walks past pooled keep-alive sockets the upstream closed while idle; an upstream that closes a fresh connection without answering now costs exactly one attempt instead of up to four. Retry backoff also ends as soon as the request context is cancelled, freeing the worker immediately instead of after up to `retry_backoff_max` (#7035, #7105)
- **Abandoned Request Billing Coin Flip** - Non-streaming requests whose caller had already disconnected were billed and logged only about half the time. The worker's delivery `select` had two simultaneously ready cases, a send into a cap-1 channel and `ctx.Done()`, and Go picks uniformly among ready cases, so terminal post-hooks were skipped roughly 50% of the time. The worker now checks `req.Context.Err()` before the select and calls `billAbandonedTerminal` deterministically, keeping the 5-second timer guard for a caller that leaves between the check and the send (#6972, #7116)
- **Stream Never Terminated Without `[DONE]`** - An OpenAI-compatible upstream that omits `[DONE]` and then goes silent after `finish_reason` no longer fails the stream when `stream_idle_timeout_in_seconds` fires. The chat and text completion read loops treat an idle timeout after a terminal signal as a parked upstream, abandon the connection rather than drain it, and synthesize the final chunk with the buffered `finish_reason`; a stall before `finish_reason` still surfaces as the idle-timeout error (#7108, #7115)
- **Dropped SSE Frames in `raw_response`** - Role-only, finish-only and usage-only frames never entered the chunk-forwarding branch, so their bytes were discarded from the reconstructed `raw_response`, leaving the captured audit trail irreconcilable against a provider invoice since the usage frame carries the token counts Bifrost bills from. A `pendingRawFrames` buffer drains onto the next forwarded chunk or the synthetic terminal chunk, the Responses-over-Chat fallback no longer stamps one upstream frame onto every derived event, and `delta.refusal` and `delta.annotations` are forwarded instead of dropped entirely (#7144, #7184)
- **Bedrock Mantle Trailing Usage** - Bedrock Mantle chat streaming no longer drops the usage-only chunk that arrives after `finish_reason`; `ProviderSendsDoneMarker` now treats `bedrock_mantle` and the legacy Mantle route under the `bedrock` key as sending `[DONE]`, so streamed usage and cost are recorded (#7065, #7076)
- **Fallbacks Re-Ran the Primary for Image and Video Edits** - Fallbacks for image edit, image variation and video edit requests now reach the configured fallback provider and model. `prepareFallbackRequest` had no arm for those three types, so the shallow copy kept the primary's sub-request pointer and the attempt was routed back to the primary while routing info, headers, the log row and the `fallback_index` metric label all reported it as a fallback. The helper now verifies the prepared request targets the fallback and skips it with a warning otherwise, so a future request type added without an arm fails loudly (#6966, #7118)
- **Provider Response Headers Leaked Across Fallbacks** - `clearCtxForFallback` missed `BifrostContextKeyProviderResponseHeaders`. Providers set that key before the status check so error paths can forward it, and when a fallback failed pre-flight (key selection failed, a plugin short-circuited, the queue was retiring) nothing overwrote it, so the client received a response attributed to provider B carrying provider A's `Retry-After` and rate-limit headers (#6973, #7021) (thanks [@Huang-404-Q](https://github.com/Huang-404-Q)!)
- **Credential-Bearing Response Headers Forwarded** - The provider-response extractors filtered only against a fixed map of 28 exact names, so any credential-named header outside it was re-served to the inference caller in both the HTTP response and `extra_fields.provider_response_headers`. The path now also consults `schemas.IsSensitiveHeader`, which recognizes credential names by substring and suffix and already knew about `cf-access-*` and `x-amzn-oidc-*`; a fixed list cannot enumerate the space when `network_config.extra_headers` exists to carry custom auth headers and some upstreams echo request headers back (#7120, #7121) (thanks [@Atharva-Kanherkar](https://github.com/Atharva-Kanherkar)!)
- **Nil Dereference on Incomplete Fallback Errors** - A plugin returning a `BifrostError` whose nested `Error` field is nil crashed the request worker. Fallback processing now nil-checks the error and guards access to `Error.Type`, using the nil-safe `GetErrorString()` helper, and continues to the next fallback when allowed (#6967, #7110) (thanks [@Constantine3](https://github.com/Constantine3)!)
- **Bedrock Duplicate Document Names** - Every untitled document block was given the literal default name `document`, and Converse rejects duplicate document names, so any request with two or more untitled documents failed unconditionally with a `ValidationException`. A per-request document namer now disambiguates with numeric suffixes (`document`, `document-2`, and so on) and suffixes titled documents only on an actual collision, on both the Converse and Responses replay paths (#7003, #7027) (thanks [@Huang-404-Q](https://github.com/Huang-404-Q)!)
- **Bedrock Text Document Source** - Converse rejects document blocks that use a text-only `DocumentSource` unless citations are explicitly enabled, so plain text formats (`text/plain`, `text/markdown`, `text/csv`, `text/html`) failed with `must set one of the following keys: bytes, s3Location`. All document content, including data URLs, percent-encoded payloads and `file_data`, now ships base64-encoded through `source.bytes` (#7072, #7079)
- **Bedrock Tool Result Images** - Some Bedrock-hosted models (OpenAI and Grok families) reject image blocks placed directly inside a `toolResult` in Converse, even though they accept images in tool output via Responses. A `hoistToolResultImages` pass moves images out of `toolResult` blocks and re-inserts them after the last tool result in the same message, leaving a placeholder text block so the now image-free result is not rejected for being empty. A datasheet row `supports_converse_tool_result_images` overrides the family-level default (#7150)
- **gpt-oss Message Mistagging on Mantle** - Claude Code replaying a prior assistant message through `POST /anthropic/v1/messages` at a Bedrock Mantle model was rejected with hundreds of validation errors: the Bedrock-grouped ingress converter tagged user and system input text as `output_text` (only `input_text` is valid on input messages) and omitted the required `status` on replayed assistant messages. Bedrock requests with no explicit `max_tokens` now also populate it from the model's known capacity instead of truncating silently (#7074, #7075)
- **Azure Foundry Output Token Cap** - Azure Foundry deployments of Fireworks-hosted models were silently capped at 4096 output tokens on `/openai/v1/responses` because Microsoft routes those models through chat completions internally. The Azure provider now checks the model's datasheet `supported_endpoints` and transparently serves both `Responses` and `ResponsesStream` through `/openai/v1/chat/completions` when `/v1/responses` is absent. Separately, a turn truncated by the output-token cap on any OpenAI-shaped Responses provider now reports `stop_reason: max_tokens` on the Anthropic egress instead of hiding the truncation as `end_turn` (#6782, #7142)
- **Gemini Inline Image and Audio Dropped** - Gemini image-generation output (`inlineData`) was silently dropped on `/v1/chat/completions`, both unary and streaming (#7032, #7033) (thanks [@Atharva-Kanherkar](https://github.com/Atharva-Kanherkar)!)
- **Gemini Image Edit Misclassified** - `isImageEditRequest` only checked `contents[0].parts[0]`, so a request with the prompt text before the `inlineData` part, which is the ordering in Google's own REST edit sample, was misclassified as image generation: the image never reached Vertex and the model invented a picture from the prompt alone, returning HTTP 200. Detection now scans all parts across all contents. `imageConfig.aspectRatio` is also preserved as a typed parameter instead of being folded into a `WxH` size string that collapsed any unsupported ratio to `1:1` (#7173)
- **Gemini Per-Part Media Resolution Dropped** - `Part` was missing `mediaResolution`, which overrides `generationConfig.mediaResolution` for a single part, and because `Part.UnmarshalJSON` decodes into a closed alias the key was discarded before any conversion ran. Per-part image and PDF tokenization fell back to the model default, so an `ULTRA_HIGH` image billed about 21k prompt tokens through `/genai` instead of about 22.1k direct. The field now round-trips both spellings end to end and is stripped on the OpenAI wire path where it is unknown (#7156)
- **Gemini `generationConfig` Lost Across Retries** - `convertParamsToGenerationConfigResponses` deleted `top_k`, `frequency_penalty`, `presence_penalty`, `stop_sequences` and `media_resolution` from `ExtraParams` while mapping them into `generationConfig`, and that conversion runs once per attempt on the same request, so every retry or fallback after the first was sent without them. On Vertex the only visible signal was `promptTokenCount` halving on retried requests, making the downgrade silent (#7138) (thanks [@VictorRequenaMaisa](https://github.com/VictorRequenaMaisa)!)
- **MCP Tool Schema Property Order** - MCP tool schemas keep one property and `$defs` order across tool syncs, so prompt caching is not invalidated by reordering alone (#7169, #7170) (thanks [@dougcalobrisi](https://github.com/dougcalobrisi)!)
- **vLLM Alias Resolution During Key Selection** - The generic allow and block lists correctly evaluated the user-facing alias, but vLLM key selection compared each key's physical `model_name` against the unresolved alias and rejected valid keys. The alias is now resolved per key before that comparison, so the same public alias can map to different physical model IDs across vLLM instances, while allow and block checks keep matching the original alias. Allowed Models, Blocked Models and Deployments/Aliases are now exposed on the vLLM key form (#6956) (thanks [@Constantine3](https://github.com/Constantine3)!)
- **opencode-zen Responses Routing** - opencode-zen Responses calls are routed through `/v1/chat/completions`, which its upstream serves, instead of `/v1/responses`, which it does not (#6778, #6819) (thanks [@miguelchico](https://github.com/miguelchico)!)
- **DeepSeek `max_completion_tokens` Ignored** - DeepSeek's chat-completions endpoint only recognizes the legacy `max_tokens` field and silently ignores `max_completion_tokens`, so the limit had no effect. The field is now remapped on the wire, matching the behaviour already in place for Opencode and Ollama (#7131)
- **Anthropic Server Tools on Third-Party Endpoints** - Fireworks' Anthropic-compatible endpoint returns 400 when a request includes Anthropic server tools such as `web_search_20250305`, because those run on Anthropic-operated infrastructure that does not exist on third-party hosts; clients whose built-in web search is always on hit this on every request. Unsupported server tools are now dropped before the request leaves Bifrost, the caller's function tools are kept, and the drops are reported on `DroppedUnsupportedTools` instead of failing the call. The same applies to vLLM and SGLang (#7090)
- **Bedrock Guardrail Headers** - Bedrock's OpenAI-compatible endpoints apply guardrails through request headers rather than the `guardrailConfig` body field Converse uses, so a configured guardrail was silently ignored there. `guardrailIdentifier`, `guardrailVersion` and `trace` are now mapped to the `X-Amzn-Bedrock-Guardrail*` headers on both chat completions and responses, streaming and non-streaming, and the key is consumed so it is not also emitted into the body. A half-formed config with only one of identifier or version is left untouched rather than sent (#7095)
- **Responses SSE `item: null`** - Responses stream events that carry no item payload no longer serialize `"item": null`, which strict OpenAI Responses clients reject as an invalid frame, breaking streamed `/v1/responses` usage (#6395) (thanks [@ReStranger](https://github.com/ReStranger)!)
- **Responses `action` String Decode** - `image_generation_call` items where OpenAI emits `action` as a bare JSON string failed to decode, because `UnmarshalJSON` immediately peeked at a `.type` field that cannot be read from a string. That silently dropped the `response.output_item.done` and `response.completed` events carrying the image, leaving the stream without a terminal event and surfacing as a bogus "provider closed the stream" truncation error. The completed item also keeps the generation settings OpenAI echoes back (#7060)
- **Mid-Conversation System Messages Broke Prompt Caching** - Mid-conversation `role: "system"` messages are inlined in place as `<system-reminder>` user turns on every converter with a top-level system field: Bedrock Converse (Responses and Chat Completions), Gemini Chat Completions, and the Anthropic wire shape used by DeepSeek, Fireworks and SGL. Previously only Claude on Bedrock and Anthropic inlined; everything else hoisted each reminder into the top-level system block. Claude Code appends a trailing `<total_tokens>` reminder after every turn, so the hoisted block grew the front of the prompt each turn and prefix-based caches reported a full cache write and zero cache reads on every turn (#7145)
- **Unsupported `reasoning.context` Rejected the Request** - A `reasoning.context` value the target model does not accept is dropped on the OpenAI and Azure Responses path, so `all_turns` on the original gpt-5 family including gpt-5-pro, gpt-5.1 to gpt-5.3 and the o-series runs under the model's own `current_turn` default instead of failing with `Unsupported value`. gpt-5.4, gpt-5.5 and gpt-5.6 keep it. Accepted values come from the datasheet row `supported_reasoning_contexts` (#7140)
- **ClickHouse Retention Filled Replica Disks** - ClickHouse log store deletes no longer run as heavyweight `ALTER TABLE ... DELETE` mutations. The retention cleaner issued one per 100 rows, each rewriting the whole current-month part, and the once-a-minute stale-`processing` sweeps issued one per table unconditionally. Every delete is now a single lightweight `DELETE FROM ... WHERE` per run, skipped when nothing matches. The table TTL derived from `logs_store.retention_days` is reconciled on every startup with a metadata-only `MODIFY TTL`, so changing the value reaches existing tables; `0` leaves an existing TTL untouched (#7098, #7103)
- **Governance Cleanup Dump Race** - `UsageTracker.Cleanup()` took its final budget and rate-limit snapshots before stopping the periodic reset worker, so `trackerCancel()` could cancel an in-flight dump and fail with `context canceled`. The worker is now cancelled and awaited before the final dumps, a queued ticker event cannot start another reset cycle during shutdown, and `context.Canceled` is treated as expected only when the tracker context was actually cancelled (#7099, #7100) (thanks [@Constantine3](https://github.com/Constantine3)!)
- **OAuth Refresh Failed for Public Clients** - Public OAuth2 clients registered against servers that only support `token_endpoint_auth_method: none` have no client secret, and unconditionally setting `client_secret=` in the refresh POST body sent an empty `client_secret_post` attempt. Strict authorization servers answered `invalid_client`, flipping the token row to `needs_reauth` even though the refresh token was valid. The parameter is now omitted when the secret is empty, matching the PKCE code-exchange path (#7042)
- **Complexity Router Skipped Continuation Turns** - When a turn is a continuation, such as a tool result following a prior user message, the complexity router discarded the extracted input and skipped classification entirely if no active session was found, leaving new or recovered sessions without a tier. Continuation turns now keep the populated `ComplexityInput` and fall back to classifying the recovered `LastUserText`; the skip path applies only when that is also empty (#7122)
- **Runtime Responses-Compat Routing** - Bedrock runtime models that serve the Responses API are routed to it through a dedicated surface resolver rather than falling back to Converse (#7071)
- **Bedrock Mantle Base Path** - Bedrock Mantle serves each model on exactly one of two base paths (`v1` or `openai/v1`) and returns a 400 on the other. Hard-coded string matching in two packages covered only generations up to GPT-5 and Gemma 4, so GPT-6 and any future closed-generation model silently fell through to the wrong path. Resolution is centralized in `ResolveBedrockMantleBasePath`, backed by a `bedrock_mantle_base_path` datasheet field with family-name detection as the fallback, so a new generation needs a datasheet row rather than a code change (#7077)
- **Virtual Key `allowed_models: ["*"]` Handling Reverted** - The wildcard handling for governance virtual keys added in #6767 is reverted. Configurations relying on `allowed_models: ["*"]` with an empty synced catalog return to the previous behaviour (#7053)
- **Helm `perUserHeaderKeys` Not Rendered** - `mcp.clientConfigs[].perUserHeaderKeys` is mapped into the rendered `config.json` (#6033, #6034) (thanks [@CallumWayve](https://github.com/CallumWayve)!)
- **Helm Plural Access Profiles** - Governance roles accept `access_profiles` as an array in the Helm and config schemas. Bifrost supports multiple access profiles but the schemas accepted only the deprecated singular `access_profile`. The singular form keeps rendering unchanged, the plural wins when both are present, and an explicitly empty plural list clears existing grants (#7044) (thanks [@CarlosLanderas](https://github.com/CarlosLanderas)!)
- **Sidebar Title Overflow** - Long sidebar item titles are truncated instead of overflowing (#7069)
- **MCP Logs App Icon** - App icons in the MCP logs table render at 20x20 and no longer shrink when the column is narrow (#7167)
## 🗄️ Database Migrations
- **add_use_openai_endpoints_column** - Adds the `use_openai_endpoints` column to the provider keys table for Bedrock OpenAI-compatible endpoint routing. Reversible: the rollback drops the added column. Additive and nullable, so it is safe to run during a rolling upgrade.
- **add_time_of_day_pricing_columns** - Adds `off_peak_cost_multiplier` and `peak_hours` to `governance_model_pricing` for time-of-day pricing. Reversible: the rollback drops both added columns. Additive and nullable, so it is safe to run during a rolling upgrade.
- **mcp_tool_logs_add_governance_snapshots** - Adds twelve governance attribution columns to `mcp_tool_logs`: `user_name`, `team_name`, `customer_name`, `business_unit_name`, the `team_ids`/`team_names`, `customer_ids`/`customer_names` and `business_unit_ids`/`business_unit_names` pairs, plus `budget_ids` and `rate_limit_ids`. Reversible: the rollback drops all twelve in reverse order. Additive and nullable, so it is safe to run during a rolling upgrade. The twelve `ALTER TABLE`s run under a bounded DDL lock wait, so startup does not stall behind a long-running log transaction holding `ACCESS EXCLUSIVE` on a continuously written table.
## 🐙 Closed GitHub Issues
- [#6033](https://github.com/maximhq/bifrost/issues/6033) - Helm chart: mcp.clientConfigs[].perUserHeaderKeys not rendered into config.json
- [#6778](https://github.com/maximhq/bifrost/issues/6778) - opencode-zen Anthropic endpoint fails, zen upstream doesn't support /v1/responses
- [#6782](https://github.com/maximhq/bifrost/issues/6782) - Azure Fireworks/Foundry models capped at 4096 output tokens on Responses + Anthropic ingress (chat completions is not); truncation reported as end_turn
- [#6825](https://github.com/maximhq/bifrost/issues/6825) - Bedrock provider silently drops Anthropic compaction (compact_20260112), capability matrix says supported, but Claude egress is Converse-only
- [#6966](https://github.com/maximhq/bifrost/issues/6966) - fallbacks silently re-target the primary provider for image edit / variation requests
- [#6967](https://github.com/maximhq/bifrost/issues/6967) - shouldContinueWithFallbacks nil-derefs BifrostError.Error, crashing the process on a plugin-returned error
- [#6972](https://github.com/maximhq/bifrost/issues/6972) - abandoned-request billing is a ~50% coin flip when a client disconnects mid-request
- [#6973](https://github.com/maximhq/bifrost/issues/6973) - provider response headers leak across fallback boundaries (clearCtxForFallback misses ProviderResponseHeaders)
- [#7003](https://github.com/maximhq/bifrost/issues/7003) - Bedrock Converse assigns duplicate default name "document" to untitled document blocks, ValidationException
- [#7032](https://github.com/maximhq/bifrost/issues/7032) - Gemini image-generation output (inlineData) silently dropped on /v1/chat/completions, both unary and streaming
- [#7034](https://github.com/maximhq/bifrost/issues/7034) - `default_request_timeout_in_seconds` and `stream_idle_timeout_in_seconds` do not fire while waiting for response headers, a silent upstream blocks the request until the upstream closes, and the fallback is never used
- [#7035](https://github.com/maximhq/bifrost/issues/7035) - upstream retries continue after the client has disconnected, and go past `max_retries`, one abandoned request produced 10 upstream attempts over ~20 minutes
- [#7048](https://github.com/maximhq/bifrost/issues/7048) - Compat namespace flattening creates duplicate tool names for DeepSeek 4.1 Flash
- [#7065](https://github.com/maximhq/bifrost/issues/7065) - Bedrock Mantle chat streaming drops trailing usage after finish_reason
- [#7072](https://github.com/maximhq/bifrost/issues/7072) - Bedrock Converse drops text-format document bytes, DocumentSource "must set one of the following keys: bytes, s3Location" (v1 to v2 regression)
- [#7074](https://github.com/maximhq/bifrost/issues/7074) - openai.gpt-oss-120b via Bedrock Responses API mistags replayed history as output_text instead of input_text, breaks multi-turn Claude Code sessions
- [#7098](https://github.com/maximhq/bifrost/issues/7098) - ClickHouse logs store: retention cleaner runs one `ALTER TABLE ... DELETE` mutation per 100 rows and fills replica disks
- [#7099](https://github.com/maximhq/bifrost/issues/7099) - UsageTracker cleanup races the periodic rate-limit dump during shutdown
- [#7108](https://github.com/maximhq/bifrost/issues/7108) - Custom-provider streaming never terminates when the upstream omits [DONE] (heartbeats mask stream_idle_timeout_in_seconds)
- [#7120](https://github.com/maximhq/bifrost/issues/7120) - Provider response-header filter ignores IsSensitiveHeader, forwarding credential-named headers to inference callers
- [#7143](https://github.com/maximhq/bifrost/issues/7143) - does_not_send_done_marker drops trailing Chat Completions usage and records zero cost
- [#7144](https://github.com/maximhq/bifrost/issues/7144) - Chat Completions streaming raw_response omits usage-only and finish-only SSE frames
- [#7155](https://github.com/maximhq/bifrost/issues/7155) - Bedrock-native invoke ingress silently drops Anthropic tool search (`tool_search_tool_*` / `defer_loading`), served eagerly over Converse
- [#7169](https://github.com/maximhq/bifrost/issues/7169) - MCP tool schema property order changes between tool syncs, breaking prompt caching
### Installation
#### Docker
```bash
docker run -p 8080:8080 maximhq/bifrost:v2.2.0
```
#### Binary Download
```bash
npx @maximhq/bifrost --transport-version v2.2.0
```
### Docker Images
- **`maximhq/bifrost:v2.2.0`** - This specific version
- **`maximhq/bifrost:latest`** - Latest version (updated with this release)
---
_This release was automatically created with dependencies: core `v1.9.0`, framework `v1.7.0`. All plugins have been validated and updated._Related Repositories
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
The world’s fastest framework for building websites.
:cherry_blossom: A command-line fuzzy finder