plugins/semanticcache/v1.7.0

maximhq/bifrostplugins/semanticcache/v1.7.0Oct 13, 2026by akshaydeo

Upgrading?

AI Summary

Introduces user-based scoping for cache entries and a configuration option to skip caching tool call responses. It also improves cache key generation and fixes race conditions in async cache writes.

Key Highlights

  • Scope cache entries by virtual key and user
  • New cache_tool_call_responses config option
  • Record lookup outcomes in response headers
  • Isolate cache entries by request family

New Features

  • Scope cache entries by virtual key and user
  • cache_tool_call_responses option to skip caching responses
  • Record lookup outcome for x-bifrost-cache-* response headers
  • Isolate cache entries by request family
  • Snapshot response before PostLLMHook returns

Full Release Notes

## Plugin Release: semanticcache v1.7.0

- feat: scope cache entries by virtual key and user, with a disable_identity_scoping opt-out
- feat: cache_tool_call_responses (default false) skips caching responses that carry client-executed tool calls, shell_call and apply_patch_call included
- feat: record lookup outcome for x-bifrost-cache-* response headers, including streams
- feat: implement HTTPTransportResponseHeadersHook as a no-op
- fix: isolate cache entries by request family (thanks [@Atharva-Kanherkar](https://github.com/Atharva-Kanherkar)!)
- fix: snapshot the response before PostLLMHook returns so async cache writes do not race core cleanup
- fix: placeholder vector on embedding failure and stricter config validation
- fix: include embedding task params in the cache hash
- chore: build cache keys from the new embedding input shape and the new oauth_key_config key schema
- chore: upgraded core to v1.12.0 and framework to v1.9.0

### Installation

```bash
# Update your go.mod to use the new plugin version
go get github.com/maximhq/bifrost/plugins/semanticcache@v1.7.0
```

---
_This release was automatically created from version file: `plugins/semanticcache/version`_

Related Repositories