v1.14.0

xorbitsai/inferencev1.14.0Nov 30, 2025by XprobeBot

AI Summary

This release adds vLLM 0.11.1+ compatibility, introduces new virtualenv APIs, adds support for rerank model for llamacpp, and enhances startup parallelization.

Key Highlights

  • Add vLLM 0.11.1+ compatibility
  • New venv spec and list/delete virtual env APIs
  • Support rerank model for llamacpp
  • Parallel startup model with tooltips for startup progress

New Features

  • Add vLLM 0.11.1+ compatibility with v1 executor support
  • New venv spec and list/delete virtual env APIs
  • Support rerank model for llamacpp
  • Show reason why engines not available
  • Parallel startup model with tooltips for startup progress

Full Release Notes

# What's new in 1.14.0 (2025-11-30)
These are the changes in inference v1.14.0.
## New features
* FEAT: add vLLM 0.11.1+ compatibility with v1 executor support by @amumu96 in https://github.com/xorbitsai/inference/pull/4252
* FEAT: [virtualenv] New v3 spec and list/delete virtual env APIs by @OliverBryant in https://github.com/xorbitsai/inference/pull/4254
* FEAT: [model] HunyuanOCR support by @OliverBryant in https://github.com/xorbitsai/inference/pull/4290
* FEAT: Add support of rerank model for llamacpp by @harryzwh in https://github.com/xorbitsai/inference/pull/4227
* FEAT: show reason why engines not available by @OliverBryant in https://github.com/xorbitsai/inference/pull/4261
* FEAT: Parallel startup model, add tooltips for startup progress, and p… by @leslie2046 in https://github.com/xorbitsai/inference/pull/4268
## Enhancements
* BLD: fix model ui launch error with gradio 6.x by @OliverBryant in https://github.com/xorbitsai/inference/pull/4289
* BLD: add pr auto run gen_docs workflow. by @yiboyasss in https://github.com/xorbitsai/inference/pull/4260
* BLD: gen docs pr modify by @OliverBryant in https://github.com/xorbitsai/inference/pull/4294
* BLD: gen doc modify v2 by @OliverBryant in https://github.com/xorbitsai/inference/pull/4296
* BLD: gen docs pr modify v3 by @OliverBryant in https://github.com/xorbitsai/inference/pull/4297
* BLD: auto-run gen_docs.py from doc/source by @yiboyasss in https://github.com/xorbitsai/inference/pull/4300
* BLD: remove [skip ci] from auto docs commit by @yiboyasss in https://github.com/xorbitsai/inference/pull/4301
## Bug fixes
* BUG: Compat with xllamacpp 0.2.5+ by @codingl2k1 in https://github.com/xorbitsai/inference/pull/4270
* BUG: add download_hubs for cluster by @OliverBryant in https://github.com/xorbitsai/inference/pull/4273
* BUG: sometimes cannot select gpu in CPU and GPU hybrid cluster by @leslie2046 in https://github.com/xorbitsai/inference/pull/4280
## Documentation
* DOC: added v1.13.0 release notes by @qinxuye in https://github.com/xorbitsai/inference/pull/4250
* DOC: update gen_docs by @qinxuye in https://github.com/xorbitsai/inference/pull/4302
## Others
* CHORE: expand stale and close time by @qinxuye in https://github.com/xorbitsai/inference/pull/4253
* chore: sync models JSON [audio, embedding, image, llm, rerank, video] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4258
* chore: sync models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4272
* chore: sync model "Qwen3-Reranker-0.6B" JSON by @OliverBryant in https://github.com/xorbitsai/inference/pull/4277
* chore: sync model "bge-reranker-v2-m3" JSON by @OliverBryant in https://github.com/xorbitsai/inference/pull/4276
* chore: sync model "Qwen3-Reranker-4B" JSON by @OliverBryant in https://github.com/xorbitsai/inference/pull/4278
* chore: sync model "Qwen3-Reranker-8B" JSON by @OliverBryant in https://github.com/xorbitsai/inference/pull/4279
* chore: sync model "qwen3" JSON by @XprobeBot in https://github.com/xorbitsai/inference/pull/4287
* chore: sync models JSON [rerank] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4284
* chore: sync model "FLUX.1-dev" JSON by @OliverBryant in https://github.com/xorbitsai/inference/pull/4293
* chore: sync model "FLUX.2-dev" JSON by @OliverBryant in https://github.com/xorbitsai/inference/pull/4292
* chore: sync models JSON [image] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4303


**Full Changelog**: https://github.com/xorbitsai/inference/compare/v1.13.0...v1.14.0