v0.9.9
neondatabase/neonv0.9.9Sep 10, 2026by tashfeenahmed
Upgrading?
AI Summary
Adds Router9 and Septor Labs providers, fixes keyless platform routing, enables response caching for streaming requests, and adds execution IDs to chat bodies.
Key Highlights
- New providers Router9 and Septor Labs join the router with key import aliases.
- Keyless platforms no longer consume the attempt budget for models without keys.
- Streaming requests can now hit the response cache and replay as byte-identical SSE.
- Every chat body now returns an `execution_id` for client-side tracking.
- Dashboard sign-in gate accessibility improved with proper labeling and ARIA attributes.
New Features
- Response cache for SSE streams (off by default).
- Caller column added to the `requests` table.
- Optimized routing for platforms without enabled keys.
- Documentation updated to describe streaming replay and observability.
Full Release Notes
## Providers - **Router9 and Septor Labs** join the router with first-class adapters: key import aliases, key-picker entries, platform colours and account-wide quota observations. Router9 keys are validated with a no-inference probe; Septor responses that come back under a different model identity are rejected as retryable before any substituted content is streamed. (#1194) ## Routing - **Keyless platforms no longer eat the attempt budget.** Models whose platform has no enabled, healthy key are dropped before the routing walk, so the "all attempts failed" summary and the retry budget only count candidates that could actually run. Pinned models are still tried and still report against their own label. (#1105, thanks @chongjiazhen) ## Cache - **Streaming requests can hit the response cache.** `stream: true` completions are stored frame by frame in their own store and replayed as byte-identical SSE on a hit, with `X-FreeLLM-Cache: HIT`. Streams are only buffered when a cache key exists, buffering stops at 2 MB, truncated or broken streams are never stored, stream lookups feed the hit-rate counters, and both stores share the one `RESPONSE_CACHE_MAX_ENTRIES` cap. Off by default, as before. (#1099, #1197, thanks @suantea) ## Observability - **`execution_id` in every chat body.** Both completion routes now return the request's execution id on success, cache hits, idempotency replays and every error body, so a client can quote it against the request log. The `requests` table gains a `caller` column, written by the OpenAI, Responses, Messages, Ollama/Gemini and fusion paths. (#1103, #1196, thanks @suantea) ## Dashboard - **Sign-in gate accessibility.** Fields are labelled, validation errors are tied to their inputs with `aria-describedby` and announced with `role="alert"`, the desktop session-repair error is announced the same way, and the gate uses `min-h-dvh` so it centres correctly on mobile viewports. Covered by tests. (#1078, #1195, thanks @Kaban15) ## Docs - Streaming-pipeline, REST API, environment and idempotency pages in `docs/en` and `docs/zh-cn` now describe streaming replay; the observability page documents `execution_id` and `caller`. README credits @Kaban15. Full changelog: https://github.com/tashfeenahmed/freellmapi/compare/v0.9.8...v0.9.9 --- ⭐ Like the free router? [Go Premium](https://freellmapi.co/?utm_source=github&utm_medium=release&utm_campaign=premium&utm_content=v0.9.9#pricing) — the live signed catalog, $19/yr, cancel anytime.
Related Repositories
A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Grok Build & Hermes Agent. Only official website: ccswitch.io
An open-source remote desktop application designed for self-hosting, as an alternative to TeamViewer.
Build smaller, faster, and more secure desktop and mobile applications with a web frontend.
π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.
Incredibly fast JavaScript runtime, bundler, test runner, and package manager – all in one