v2.11.0
xorbitsai/inferencev2.11.0Jun 19, 2026by XprobeBot
AI Summary
This release adds support for MiniCPM5, MiniCPM-V, and Tencent Hy-MT2 models while improving UI stability and adding new user management features. Core stability improvements include model loading state management and worker registry self-healing.
Key Highlights
- New models: MiniCPM5-1B, MiniCPM-V-4.6, and Tencent Hy-MT2 series
- UI: New parts 3, 4, and 5 including change password functionality
- Core: Model loading state machine to prevent routing to loading models
- Fixes: Worker registry self-healing and GPU orphan cleanup
- Audio: VoxCPM2 model support and Gradio test page
New Features
- MiniCPM5-1B model support
- MiniCPM-V-4.6 series support
- Tencent Hy-MT2 series support
- VoxCPM2 model support
- UI: Change password for local users
- Core: Model loading state machine
- LLM: GLM5 tool parser support
- Audio: Gradio test page for embedding models
Full Release Notes
# What's new in 2.11.0 (2026-06-19) These are the changes in inference v2.11.0. ## New features * feat: new UI part 3 by @maoyuehui in https://github.com/xorbitsai/inference/pull/5011 * feat: add MiniCPM5-1B model support by @xiaoyesoso in https://github.com/xorbitsai/inference/pull/5010 * feat(ui): add change password for local users in user management by @m199369309 in https://github.com/xorbitsai/inference/pull/5014 * feat: add jina-embeddings-v5 series support by @xiaoyesoso in https://github.com/xorbitsai/inference/pull/5018 * feat: add Gradio test page for embedding models by @xiaoyesoso in https://github.com/xorbitsai/inference/pull/5022 * feat: add MiniCPM-V-4.6 series support by @xiaoyesoso in https://github.com/xorbitsai/inference/pull/5025 * feat: add Tencent Hy-MT2 series support by @xiaoyesoso in https://github.com/xorbitsai/inference/pull/5029 * feat(vllm): support glm5 tool parser by @llyycchhee in https://github.com/xorbitsai/inference/pull/5019 * feat(core): add model loading state machine to prevent routing to loading models by @m199369309 in https://github.com/xorbitsai/inference/pull/5032 * feat(audio): add VoxCPM2 model support by @bluefish-08 in https://github.com/xorbitsai/inference/pull/5045 * feat: new UI part 4 by @maoyuehui in https://github.com/xorbitsai/inference/pull/5040 * FEAT: [model] PaddleOCR-VL-1.6 support by @llyycchhee in https://github.com/xorbitsai/inference/pull/5033 * feat: add random serving benchmark workload by @qinxuye in https://github.com/xorbitsai/inference/pull/5036 * feat: new UI part 5 by @maoyuehui in https://github.com/xorbitsai/inference/pull/5053 ## Enhancements * ENH: update models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/5017 * ENH: update models JSON [embedding] by @XprobeBot in https://github.com/xorbitsai/inference/pull/5020 * ENH: update models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/5026 * ENH: update models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/5034 * ENH: update models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/5038 * ENH: update models JSON [audio] by @XprobeBot in https://github.com/xorbitsai/inference/pull/5050 * bld: Replace self-hosted runner with GitHub hosted runner and update actions by @qinrui777 in https://github.com/xorbitsai/inference/pull/5000 ## Bug fixes * fix(supervisor): self-heal worker registry after supervisor restart by @m199369309 in https://github.com/xorbitsai/inference/pull/4998 * fix(metrics): drop stale series and add unexpected termination gauge by @m199369309 in https://github.com/xorbitsai/inference/pull/4999 * fix(worker): ensure subpool monitor starts after append_sub_pool by @m199369309 in https://github.com/xorbitsai/inference/pull/5004 * fix(model_registration):add flexible type by @llyycchhee in https://github.com/xorbitsai/inference/pull/5007 * fix(model): use os._exit for OOM to trigger pool recovery by @m199369309 in https://github.com/xorbitsai/inference/pull/5005 * fix(venv): add sentence_transformers dependence by @llyycchhee in https://github.com/xorbitsai/inference/pull/5009 * fix(supervisor): evict dead replica from round-robin when auto-recover exhausted by @m199369309 in https://github.com/xorbitsai/inference/pull/5006 * fix(worker): pop launch_ts in recover_model to avoid strict-constructor crashes by @m199369309 in https://github.com/xorbitsai/inference/pull/5012 * fix(deploy): fix dockerfile.cpu kernels version by @llyycchhee in https://github.com/xorbitsai/inference/pull/5013 * fix(logs): fix empty node filter dropdown and redesign toolbar layout by @m199369309 in https://github.com/xorbitsai/inference/pull/5015 * fix(monitor): correct alert rule labels/expressions and add 4 new rules by @m199369309 in https://github.com/xorbitsai/inference/pull/5016 * fix: pin FastAPI below 0.137 for metrics middleware by @qinxuye in https://github.com/xorbitsai/inference/pull/5042 * fix(core): sync model_serve_count gauge on stream request completion by @m199369309 in https://github.com/xorbitsai/inference/pull/5041 * fix(vllm): force spawn for single-GPU EngineCore and fix health check scheduling by @m199369309 in https://github.com/xorbitsai/inference/pull/5030 * fix(worker): strip test envs before recover and clean up GPU orphans by @m199369309 in https://github.com/xorbitsai/inference/pull/5031 * fix(rerank/llama.cpp): honor flat launch kwargs (n_ctx/n_batch/n_ubatch) so rerankers aren't capped at default ubatch (#5001) by @Anai-Guo in https://github.com/xorbitsai/inference/pull/5046 * fix(anthropic): honor top-level system prompt and inline system messages (#5037) by @Anai-Guo in https://github.com/xorbitsai/inference/pull/5049 * fix(vllm/patches): auto-apply hybrid KV cache patch to Qwen3-Next by @Anai-Guo in https://github.com/xorbitsai/inference/pull/5052 * fix(audio): warn and ignore non-zero temperature for Qwen3-ASR instead of raising by @Anai-Guo in https://github.com/xorbitsai/inference/pull/5054 ## Documentation * doc: add v2.10.0 release notes by @qinxuye in https://github.com/xorbitsai/inference/pull/4997 * doc: hide Zhihu link from English docs by @qinxuye in https://github.com/xorbitsai/inference/pull/5008 * doc: update documentation logo and favicon by @qinxuye in https://github.com/xorbitsai/inference/pull/5024 * doc: update Read the Docs build image by @qinxuye in https://github.com/xorbitsai/inference/pull/5044 ## Others * docs: add Telegram community links by @qinxuye in https://github.com/xorbitsai/inference/pull/5003 ## New Contributors * @qinrui777 made their first contribution in https://github.com/xorbitsai/inference/pull/5000 * @xiaoyesoso made their first contribution in https://github.com/xorbitsai/inference/pull/5010 * @bluefish-08 made their first contribution in https://github.com/xorbitsai/inference/pull/5045 * @Anai-Guo made their first contribution in https://github.com/xorbitsai/inference/pull/5046 **Full Changelog**: https://github.com/xorbitsai/inference/compare/v2.10.0...v2.11.0