v0.5.0
tashfeenahmed/freellmapiv0.5.0Jul 17, 2026by tashfeenahmed
AI Summary
A major release adding 9 new providers, Anthropic API compatibility, generative media capabilities, and an MCP server, alongside robust routing and security improvements.
Key Highlights
- 9 new providers including SEA-LION, NavyAI, and NaraRouter
- Anthropic-compatible API (`/v1/messages`) for Claude SDKs
- Generative media endpoints for image and audio generation
- MCP server at `/mcp` for coding agents
- Structured outputs support with JSON healing
New Features
- 9 new providers
- Anthropic-compatible API
- Generative media endpoints
- MCP server
- Structured outputs
- Unified provider fallback loops
- Desktop app LAN access toggle
- Self-hosted OpenAPI reference
Full Release Notes
The biggest release yet — a month of work spanning 9 new free providers, an Anthropic-compatible API, generative media, an MCP server, structured outputs, and a large reliability + security hardening pass. ## New providers (9) **SEA-LION, NavyAI, NaraRouter, Aion, Requesty, AI Horde, Routeway, BazaarLink, AINative** — all with genuine free tiers, routed behind the same single key. ## New APIs & surfaces - **Anthropic-compatible API** — `/v1/messages` works with Anthropic SDKs and tools (Claude Code included), with system-role fixes and Gemini thought-signature preservation (#361, #362, #493) - **Generative media** — image generation + audio/TTS endpoints, with Image and Audio tabs in the model browser (#358, #359) - **MCP server at `/mcp`** — gateway introspection for coding agents (#517) - **Structured outputs** — `json_schema` forwarded to providers, with JSON healing, routing filter, and format-ignore failover when a provider can't comply (#514, #516, #520) - **Legacy completions endpoint** (#340) and embeddings `dimensions` parameter for MRL truncation (#393) - **Self-hosted OpenAPI reference** at `/v1/docs` + `/v1/openapi.json` (#482) - **Opt-in response cache** for `/v1/chat/completions` (#481) ## Routing & reliability - Unified the four provider fallback loops; 401 key rotation, retry budgets, truncation policy, rich exhaustion diagnostics (#483, #484) - Per-request token budget + failover circuit breaker (#511) - Client-disconnect abort + `X-Fallback-Trail` header on every surface (#518) - Post-sleep wake recovery: drift detection, socket flush, immediate key re-probe (#515) - Multi-key improvements: pooled monthly token budgets scale with key count, embeddings/media load balancing, quota fixes (#457, #459, #479) - Provider timeout tuning from a live all-provider sweep; 60s chat timeout for reasoning-model TTFB (#519, #521) - Fusion mode: tool-call support and model-family panel diversity (#331) - Router penalty inspector + quota observability (#344) ## Security - First-run setup code; unified key moved out of the DB into a key file; CSV export hardening (#477) - Custom-provider SSRF guard, plus two follow-up bypass closures (#443, #450) ## Dashboard & desktop - Keys page redesign with tabs, provider key import/export, custom models managed from the Keys page (#327, #467, #473) - Cmd/Ctrl+K command palette, models nav dropdown, first-run checklist, skeletons, error boundary + toasts, 404 page - Consolidated provider detail pages with API usage for image/audio/embeddings (#360) - Playground: system prompt support + real error bubbles (#390) - Desktop: LAN access toggle (bind 0.0.0.0), app version in popover (#421, #447) - i18n: Italian added; complete coverage across all six locales (#367) ## Under the hood - File-per-migration DB system, `Db`/`DbStatement` interfaces, `Scheduler` abstraction with lifecycle tests (#265, #397) - Runtime-capability guards + centralized Config (#375); env-drift warning at startup (#494) - Catalog controls, persistence backup, and declarative config Full diff: https://github.com/tashfeenahmed/freellmapi/compare/v0.4.1...v0.5.0 Thanks to community contributors: @chongjiazhen, @LoneRifle, @vjsai, @Tazrif-Raim, @kairwang01 and everyone who reported issues. > **macOS note:** the DMG is not yet notarized — on first launch use right-click → Open (or `xattr -d com.apple.quarantine /Applications/FreeLLMAPI.app`). --- ⭐ Like the free router? [Go Premium](https://freellmapi.co/?utm_source=github&utm_medium=release&utm_campaign=premium&utm_content=v0.5.0#pricing) — the live signed catalog, $19/yr, cancel anytime.