plugins/routing/v1.2.0

maximhq/bifrostplugins/routing/v1.2.0Oct 13, 2026by akshaydeo

Upgrading?

AI Summary

Adds a decision-model complexity classifier for various AI models with cost tracking and introduces a timeout setting for streaming first-token delivery.

Key Highlights

  • Decision-model complexity classifier for multiple models
  • Per-tier guidance and decision cost tracking
  • ttft_timeout_ms sets first-token deadline for streaming
  • LLM fallback classifier no longer sends temperature 0

New Features

  • Decision-model complexity classifier for TypeSafe Jev, Laya, Nimble, Clef, and OpenAI
  • Send complexity classification decisions in list shape
  • ttft_timeout_ms sets first-token deadline for streaming attempts
  • Read embedding input through new item shape

Full Release Notes

## Plugin Release: routing v1.2.0

- feat: decision-model complexity classifier (TypeSafe Jev, Laya, Nimble, Clef and OpenAI decision models) as primary or semantic fallback, with per-tier guidance and decision cost tracking
- feat: send complexity classification decisions in the list shape
- feat: ttft_timeout_ms sets the first-token deadline for streaming attempts
- fix: LLM fallback classifier no longer sends temperature 0
- chore: read embedding input through the new item shape
- chore: upgraded core to v1.12.0 and framework to v1.9.0

### Installation

```bash
# Update your go.mod to use the new plugin version
go get github.com/maximhq/bifrost/plugins/routing@v1.2.0
```

---
_This release was automatically created from version file: `plugins/routing/version`_

Related Repositories