v0.13.9
SaschaHeyer/gen-ai-livestreamv0.13.9Oct 11, 2026by tashfeenahmed
Upgrading?
AI Summary
This update refines the routing logic to ensure retired models remain retired after restarts and improves the robustness of idempotent retry mechanisms, alongside various CLI and documentation improvements.
Key Highlights
- Retired models remain retired after restarts and fall through to the next model if requested by name
- Idempotent retries now check all generation options to prevent conflicts
- CLI default port changed to 3001
- Russian README added
New Features
- Retired model persistence
- Idempotent retry conflict resolution
- CLI default port change to 3001
- CSV key import fix for line breaks
- Russian README
Full Release Notes
FreeLLMAPI v0.13.9 keeps retired models out of routing, tightens idempotent retries, fixes the CLI's default port and adds a Russian README. ## Routing - **Retired models stay retired after a restart.** When a provider answers a model with 410 (end of life), FreeLLMAPI retires it. A restart used to undo that, so the dead model went back into rotation and failed again. Retirements now survive restarts and are only lifted by a newer catalog. Thanks @suantea, and @AlexQiu-coder for the report. (#1394, #1421) - **Asking for a retired model by name no longer fails every time.** A request that names a model the provider has retired now falls through to the next model in your chain. The `X-Routed-Via` header shows which model answered. (#1394, #1423) ## API - **Idempotent retries check every generation option.** Retrying with the same `Idempotency-Key` but a different `response_format`, `seed`, `stop` or `parallel_tool_calls` now returns `409 idempotency_key_conflict` instead of replaying the earlier answer. Keys stored before this update return a conflict once, then work as before. Thanks @ac1982. (#1440) ## CLI - **`npx freellmapi` defaults to port 3001**, the gateway's port, when no `--url` or `FREELLMAPI_URL` is set. Published as `freellmapi@0.8.1` on npm. Thanks @agammann. (#1437) - The CLI test suite now passes on Windows. Thanks @suantea. (#1424) ## Keys - **CSV key import handles line breaks inside quoted fields**, so a label containing a line break no longer splits the row. Thanks @Claven07. (#1384) ## Docs - **Russian README.** Thanks @The88788. (#1463) ## Updating Desktop users on v0.13.5 or later can update from inside the app: ⋯ → **Check for updates**. Docker: `ghcr.io/tashfeenahmed/freellmapi:v0.13.9`. The `latest` tag also points to this release. Existing keys and profiles are retained. This release has no database migrations. [Full changelog](https://github.com/tashfeenahmed/freellmapi/compare/v0.13.8...v0.13.9) --- ⭐ Like the free router? [Go Premium](https://freellmapi.co/?utm_source=github&utm_medium=release&utm_campaign=premium&utm_content=v0.13.9#pricing), the live signed catalog, $19/yr, cancel anytime.
Related Repositories
rasbt/LLMs-from-scratch★ 107,079
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
lyogavin/airllm★ 40,215
AirLLM 2.8T LLM inference with single 4GB GPU
NirDiamant/RAG_Techniques★ 29,962
This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.
microsoft/OmniParser★ 25,539
A simple screen parsing tool towards pure vision based GUI agent
karpathy/nn-zero-to-hero★ 24,907
Neural Networks: Zero to Hero