v0.1.42-beta
kyutai-labs/moshiv0.1.42-betaMay 26, 2026by shimmyshimmer
AI Summary
An update preceding a major revamp, introducing API calling support for external cloud providers (OpenAI, Anthropic), external connections to local servers (vLLM, Ollama), and extensive security hardening.
Key Highlights
- API calling support for OpenAI, Anthropic, and OpenRouter
- External connections to vLLM, Ollama, and llama-server
- Built-in web search and code execution for cloud providers
- Prompt caching to reduce costs by 50-90%
- Major security improvements including rate limiting and sandboxed workers
New Features
- API provider connections
- External inference backend support
- PDF/document attachments
- Prompt caching support
- Image generation and editing
- Non-English language support
- Fully offline support
Full Release Notes
Hey guys, we're doing one more-ish update before a major revamp which is likely coming this week or next week. Our revamp will change a lot of things, especially with new major features and a lot of design changes.<br> * NEW: **[API calling support](https://unsloth.ai/docs/integrations/connections)** now with image generation + editing, proper web search, code execution, auto prompt caching. Connect [OpenAI](https://unsloth.ai/docs/integrations/connections/openai), [Anthropic](https://unsloth.ai/docs/integrations/connections/anthropic-claude) and more. * `unsloth studio update` should now work properly. For Mac users, use the install curl command instead: `curl -fsSL https://unsloth.ai/install.sh | sh` * Proper support for **non-English languages** e.g. Japanese, Chinese, Indian etc. https://github.com/user-attachments/assets/70456395-e016-4273-8256-35adb206267e Many of you may have missed our previous release which only lasted for one day. We introduced: * Connect to external inference backends: [vLLM](https://unsloth.ai/docs/integrations/connections/vllm), [Ollama](https://unsloth.ai/docs/integrations/connections/ollama), [llama-server](https://unsloth.ai/docs/integrations/connections/connect-llama.cpp-to-unsloth-run-ggufs-with-llama-server) * **Security improvements** - **Auto MTP speculative decoding** for MTP GGUFs; get the best settings customized for your hardware. ## API provider calling & external connections - You can now connect Unsloth to any API cloud provider (OpenAI, Anthropic, OpenRouter etc.) - **Built-in web search** for OpenAI, Anthropic, OpenRouter and Kimi - **Built-in code execution** for OpenAI and Anthropic (Anthropic containers persist and are reused across turns) - Prompt caching is enabled for OpenAI and Anthropic models saving 50 to 90% of costs. - Image generation + editing - API key now optional for local providers (llama.cpp / vLLM / Ollama) - Auto-load models when adding a cloud provider ## Other Unsloth Studio updates - OpenDocument chat attachments - o3 reasoning summary payload - Sending/prompting non-English languages (e.g. Japanese, Chinese) now works properly - IME composer hardening, RTL `dir="auto"`, long log-line truncation fix - Tool reasoning trace rendering in UI - Fully offline support: cached GGUF discovery and offline DNS auto-detect for both inference and training ## Unsloth Studio security improvements - Authentication rate-limiting, proxy-aware so reverse proxies don't bypass it - Sandboxed worker with a tightened blocklist (bash, `hf upload`, `NOFILE`) - Path containment so workers can't escape their in-flight tmp dirs - Strict schema validation across the Studio API - Tightened CSP / security headers (only legitimate favicon hosts allowed) - Removed the `torch.load` fallback on `training_args.bin` so untrusted pickles can never execute on model load - Hardened Tauri desktop release flow - Frontend auth: singleflight token refresh, current-password input on changes, working logout, shared 422 helper - Cancel cleanup now scoped strictly to in-flight tmp dirs so it can never delete user state ## What's Changed * install: bump unsloth floor to >=2026.5.5 by @danielhanchen in https://github.com/unslothai/unsloth/pull/5621 * Studio: persist chat toggles and preserve custom sampling by @Imagineer99 in https://github.com/unslothai/unsloth/pull/5587 * Studio: add connections toggle and order hosted providers by @Imagineer99 in https://github.com/unslothai/unsloth/pull/5588 * studio/ci: harden three pre-existing CI flakes by @danielhanchen in https://github.com/unslothai/unsloth/pull/5627 * Studio: expand Connections model picker for local inference server by @Imagineer99 in https://github.com/unslothai/unsloth/pull/5643 * Move uninstall scripts into scripts/ and fix references by @danielhanchen in https://github.com/unslothai/unsloth/pull/5644 * Studio: provider model loading controls by @Imagineer99 in https://github.com/unslothai/unsloth/pull/5645 * Studio: unify connection copy by @Imagineer99 in https://github.com/unslothai/unsloth/pull/5654 * Remove dead chat suggestions wiring by @alkinun in https://github.com/unslothai/unsloth/pull/5665 * Studio: Claude Code Anthropic API tool compatibility by @Imagineer99 in https://github.com/unslothai/unsloth/pull/5390 * studio/frontend: friendlier 404 fallback for unknown routes by @danielhanchen in https://github.com/unslothai/unsloth/pull/5664 * chore(deps): bump the npm-oxc-validator group across 1 directory with 2 updates by @dependabot[bot] in https://github.com/unslothai/unsloth/pull/5667 * studio/chat: Disable send button for empty composer by @harryfrzz in https://github.com/unslothai/unsloth/pull/5647 * studio/frontend: correct Think pill aria-label before model loads by @danielhanchen in https://github.com/unslothai/unsloth/pull/5655 * studio/frontend: fix onboarding CSP violations by @danielhanchen in https://github.com/unslothai/unsloth/pull/5658 * studio/frontend: set per-route document.title by @danielhanchen in https://github.com/unslothai/unsloth/pull/5660 * Fix Windows Tauri build and signing by @wasimysaid in https://github.com/unslothai/unsloth/pull/5694 * Respect GC for GRPO by @Datta0 in https://github.com/unslothai/unsloth/pull/5269 * studio: unblock /load event loop on detect_audio_type (#5642, #5635) by @danielhanchen in https://github.com/unslothai/unsloth/pull/5669 * studio: settle GPU VRAM after killing llama-server before the next reload by @danielhanchen in https://github.com/unslothai/unsloth/pull/5693 * Studio: surface prompt-cache token counts in /v1/chat/completions usage chunk by @danielhanchen in https://github.com/unslothai/unsloth/pull/5670 * Studio: per-model Anthropic server-side tool versions by @danielhanchen in https://github.com/unslothai/unsloth/pull/5679 * Studio: support Anthropic 1h cache TTL via prompt_cache_ttl by @danielhanchen in https://github.com/unslothai/unsloth/pull/5685 * Studio: wire OpenAI image_generation tool by @danielhanchen in https://github.com/unslothai/unsloth/pull/5688 * Studio: per-session cost calculator + /api/providers/pricing endpoint by @danielhanchen in https://github.com/unslothai/unsloth/pull/5690 * Studio: wire Anthropic web_fetch server-side tool by @danielhanchen in https://github.com/unslothai/unsloth/pull/5671 * Studio: persist chat history in backend storage by @Imagineer99 in https://github.com/unslothai/unsloth/pull/5272 * Studio: wire Anthropic server-side context compaction by @danielhanchen in https://github.com/unslothai/unsloth/pull/5686 * Studio: wire OpenAI Responses server-side context compaction by @danielhanchen in https://github.com/unslothai/unsloth/pull/5687 * Studio: PDF / document attachments for Anthropic + OpenAI by @danielhanchen in https://github.com/unslothai/unsloth/pull/5689 * Studio: reconcile external providers across browsers after delete by @danielhanchen in https://github.com/unslothai/unsloth/pull/5698 * Studio: persist external provider selection across page refresh by @danielhanchen in https://github.com/unslothai/unsloth/pull/5697 * Studio: add Anthropic and OpenAI prompt guards for disabled tools by @Imagineer99 in https://github.com/unslothai/unsloth/pull/5674 * Studio: persist external checkpoint when picker uses setParams by @danielhanchen in https://github.com/unslothai/unsloth/pull/5700 * Studio: surface OpenAI image_generation as composer Images pill by @danielhanchen in https://github.com/unslothai/unsloth/pull/5699 * Studio: expose Anthropic 5m vs 1h prompt cache TTL in Configuration by @danielhanchen in https://github.com/unslothai/unsloth/pull/5703 * Fix connected chat model selection after refresh by @wasimysaid in https://github.com/unslothai/unsloth/pull/5702 * Studio: render OpenAI image_generation results inline in chat by @danielhanchen in https://github.com/unslothai/unsloth/pull/5705 * Truncate long code execution tool output by @wasimysaid in https://github.com/unslothai/unsloth/pull/5708 * fix(gpt-oss): prefer flex attention over sdpa by @Datta0 in https://github.com/unslothai/unsloth/pull/5701 * Bump install.sh / install.ps1 pin to unsloth>=2026.5.6 by @danielhanchen in https://github.com/unslothai/unsloth/pull/5716 * ci: unblock Studio Windows + Linux + Mac smoke (supersedes #5733, #5734, #5738) by @danielhanchen in https://github.com/unslothai/unsloth/pull/5741 * ci: broaden Linux + narrow Windows llama.cpp runtime patterns + trim #5741 comments by @danielhanchen in https://github.com/unslothai/unsloth/pull/5746 * Lower default RL weight_decay from 0.01 to 0.001 for LoRA by @danielhanchen in https://github.com/unslothai/unsloth/pull/5747 * Studio: strip orphan tool_call XML leaking into visible content by @danielhanchen in https://github.com/unslothai/unsloth/pull/5735 * Bump install.sh / install.ps1 pin to unsloth>=2026.5.7 by @danielhanchen in https://github.com/unslothai/unsloth/pull/5753 * Fix MLX Studio base model export save method by @Lyxot in https://github.com/unslothai/unsloth/pull/5727 * fix(chat_templates): check find() return value before slicing on placeholders by @Ricardo-M-L in https://github.com/unslothai/unsloth/pull/5763 * [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/unslothai/unsloth/pull/5773 * Studio: stop seeded admin to cross-origin callers by @danielhanchen in https://github.com/unslothai/unsloth/pull/5739 * Studio: surface external-provider cache hits and writes in context bar by @danielhanchen in https://github.com/unslothai/unsloth/pull/5736 * Studio: Anthropic fast_mode toggle and streaming refusal handling by @danielhanchen in https://github.com/unslothai/unsloth/pull/5715 * Studio: rewrite OpenAI Responses citation markers to markdown links by @danielhanchen in https://github.com/unslothai/unsloth/pull/5713 * Studio: standalone Fetch pill for Anthropic web_fetch by @danielhanchen in https://github.com/unslothai/unsloth/pull/5742 * Studio: surface Anthropic document citations inline + in Sources panel by @danielhanchen in https://github.com/unslothai/unsloth/pull/5718 * Studio: pricing follow-up to #5690 (longest-prefix match + chat-style usage keys) by @danielhanchen in https://github.com/unslothai/unsloth/pull/5722 * Support follow-up edits for generated images by @wasimysaid in https://github.com/unslothai/unsloth/pull/5712 * Recipe Studio local model selector by @wasimysaid in https://github.com/unslothai/unsloth/pull/5769 * Improve image generation UI by @wasimysaid in https://github.com/unslothai/unsloth/pull/5784 * Studio: per-card web_search result + shell_call output fallback (OpenAI) by @danielhanchen in https://github.com/unslothai/unsloth/pull/5785 * Keep generated image loading dots animated by @wasimysaid in https://github.com/unslothai/unsloth/pull/5786 * Studio: auto-recover when shadowed 'unsloth' on PATH hides the frontend dist by @danielhanchen in https://github.com/unslothai/unsloth/pull/5782 * studio/frontend: show "1 second" instead of "1 seconds" in thinking blocks by @oobabooga in https://github.com/unslothai/unsloth/pull/5777 * Studio: stop the model from replying twice when it refuses by @oobabooga in https://github.com/unslothai/unsloth/pull/5775 * studio/frontend: add space above the scroll-to-bottom arrow in chat by @oobabooga in https://github.com/unslothai/unsloth/pull/5776 * Fix unsloth studio update silently downgrading on macOS arm64 by @danielhanchen in https://github.com/unslothai/unsloth/pull/5767 ## New Contributors * @harryfrzz made their first contribution in https://github.com/unslothai/unsloth/pull/5647 * @Lyxot made their first contribution in https://github.com/unslothai/unsloth/pull/5727 * @oobabooga made their first contribution in https://github.com/unslothai/unsloth/pull/5777 **Full Changelog**: https://github.com/unslothai/unsloth/compare/v0.1.41-beta...0.1.417-beta