v0.13.1
TEN-framework/ten-frameworkv0.13.1Sep 29, 2026by tashfeenahmed
Upgrading?
AI Summary
FreeLLMAPI v0.13.1 resolves false 'Rate limited' errors for coding agents by accurately calculating request sizes including tool definitions, preventing requests to undersized models.
Key Highlights
- Router now counts tool definitions to ensure requests fit model limits.
- Fixes false 'Rate limited' errors caused by large tool definitions in agents.
- Corrects interpretation of Groq error messages to prevent daily quota exhaustion.
New Features
- Tool definition inclusion in request sizing logic
- Updated `/v1/messages/count_tokens` endpoint to include tool definitions
- Groq error handling improvements
Full Release Notes
FreeLLMAPI v0.13.1 fixes "Rate limited" errors when you use Claude Code, Claude Desktop and other coding agents through the router. ## Fixes - **Claude Code and other agents no longer hit false "Rate limited" errors.** Coding agents send large tool definitions with every message, and the router left them out when sizing a request. It could send an agent's request to a model too small for it, such as Groq's 8k-per-minute models. The provider turned it down as too large, and the router reported that back as a rate limit. The router now counts tool definitions and sends each request only to models that can take it. This covers Claude Code, Claude Desktop, OpenAI-compatible agents, the Responses API and the Gemini/Ollama endpoints. (#1362) - **Groq errors no longer read as a used-up daily quota.** Every Groq limit error ends with "Upgrade to Dev Tier today", which the router mistook for a daily limit. Groq's per-minute limits now recover within the minute. (#1362) - **A request that is too large no longer benches the model.** The model is skipped for that one request only and stays available for everything else. Before, one large agent request could pile up penalties across your models. (#1362) - `/v1/messages/count_tokens` now includes tool definitions in its count. ## Updating Download the installer for your platform below, or use `ghcr.io/tashfeenahmed/freellmapi:v0.13.1` for Docker. The `latest` Docker tag also points to this release. Desktop users on v0.13.0 will see this update in the Updates panel. Existing keys and profiles are retained. This release has no database migrations. [Full changelog](https://github.com/tashfeenahmed/freellmapi/compare/v0.13.0...v0.13.1) --- ⭐ Like the free router? [Go Premium](https://freellmapi.co/?utm_source=github&utm_medium=release&utm_campaign=premium&utm_content=v0.13.1#pricing), the live signed catalog, $19/yr, cancel anytime.
Related Repositories
public-apis/public-apis★ 491,128
A collective list of free APIs
NousResearch/hermes-agent★ 255,903
The agent that grows with you
yt-dlp/yt-dlp★ 200,002
A feature-rich command-line audio/video downloader
microsoft/markitdown★ 191,481
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPT★ 187,700
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.