v1.11.1
Mintplex-Labs/anything-llmv1.11.1Mar 2, 2026by timothycarambat
AI Summary
Homepage redesign, native tool calling overhaul, and AMD Lemonade integration to improve performance and user onboarding.
Key Highlights
- Completely redesigned homepage for instant start.
- Overhauled native tool calling for multi-step tool usage.
- AMD Lemonade integration for local model optimization.
- Safeguards implemented to prevent infinite loops (max 10 tool calls).
New Features
- Homepage redesign.
- Native Tool calling implementation.
- AMD Lemonade by AMD integration.
Full Release Notes
## Homepage Redesign The main AnythingLLM homepage has been completely redesigned to be more modern and user-friendly so you can instantly start chatting the second you open the app after onboarding. <img width="3680" height="2212" alt="homepage" src="https://github.com/user-attachments/assets/b7b202b1-3a22-42c9-b46e-434b694c2ec5" /> ## Native Tool Calling <Callout type="info"> Native tool calling is the best performance and experience for tool calling with your LLM provider and model. If you can enable it, you should. _this only applies to local LLM providers. It has no impact on cloud LLMs like OpenAI, Anthropic, or Azure._ </Callout> We have completely overhauled how `@agent` tool calling works. Now, we will leverage the new native tool calling abilities of your LLM provider and model. **What this means for you:** - You can now run complex, **multi-step** tool calls with your LLM provider and model. - Your model will now continue to work until your final response is generated or determined to be complete. - You will get 100x better responses from even small tool-calling models We have implemented safeguards as well to prevent infinite loops with a maximum of 10 tool calls per response to prevent runaway tasks. <img width="3680" height="2212" alt="native-tool-calling" src="https://github.com/user-attachments/assets/52676899-77ca-4fdc-b728-9d61c7834536" /> ### Limitations Most providers do not allow us to probe for if a model supports native tool calling. The following local LLM providers will automatically support native tool calling if your model supports it: - Default Built in LLM Provider (AnythingLLM Default) - Ollama - LM Studio For others, you will need to set an ENV variable to enable native tool calling for supported providers. - Generic OpenAI - Groq - AWS Bedrock - Lemonade - LiteLLM - Local AI - OpenRouter This can be set via the [`PROVIDER_SUPPORTS_NATIVE_TOOL_CALLING`](/configuration#native-tool-calling-for-llm-providers) environment variable. ``` PROVIDER_SUPPORTS_NATIVE_TOOL_CALLING="bedrock,generic-openai,groq,lemonade,litellm,local-ai,openrouter" ``` ## Lemonade by AMD Integration <img width="3440" height="1624" alt="lemonade" src="https://github.com/user-attachments/assets/9f1b56bc-0ad4-48ac-972d-a6541b2225f7" /> [Lemonade](https://lemonade-server.ai) by AMD is an [open-source](https://github.com/lemonade-sdk/lemonade) local model runtime that optimizes performance and efficiency for local models (LLM, ASR, TTS, Image Generation, etc.) for all types of hardware including AMD GPUs and NPUs. We have added first class support so you can use your local models running via Lemonade within AnythingLLM for the best application experience on top of your local hardware. ----- ## What's Changed * fix: typo in contribution guidelines, update project metadata and pull_request_temp...md by @dipanshurdev in https://github.com/Mintplex-Labs/anything-llm/pull/5010 * feat: update light mode UI sidebar by @angelplusultra in https://github.com/Mintplex-Labs/anything-llm/pull/4996 * fix(frontend): fix event listener memory leak in useIsDisabled hook by @dipanshurdev in https://github.com/Mintplex-Labs/anything-llm/pull/5027 * feat: dedicated dark theme option with system preference support by @angelplusultra in https://github.com/Mintplex-Labs/anything-llm/pull/5007 * Implement new home page redesign by @shatfield4 in https://github.com/Mintplex-Labs/anything-llm/pull/4931 * fix: GitLab connector infinite loop and rate limit crash for large repos by @angelplusultra in https://github.com/Mintplex-Labs/anything-llm/pull/5021 * fix: add password character validation to onboarding single-user setup by @angelplusultra in https://github.com/Mintplex-Labs/anything-llm/pull/5037 * Native Tool calling by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/5071 * fix: resolve Gemini agent 400 error on tool call responses by @angelplusultra in https://github.com/Mintplex-Labs/anything-llm/pull/5054 * fix: prevent CMD/CTRL+Arrow scroll from overriding textarea cursor movement by @angelplusultra in https://github.com/Mintplex-Labs/anything-llm/pull/5053 * Normalize scraper runtimeargs for bulk-scraper by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/5083 * Lemonade integration by @timothycarambat in https://github.com/Mintplex-Labs/anything-llm/pull/5077 ## New Contributors * @dipanshurdev made their first contribution in https://github.com/Mintplex-Labs/anything-llm/pull/5010 **Full Changelog**: https://github.com/Mintplex-Labs/anything-llm/compare/v1.11.0...v1.11.1