Starstruk Logo MarkStarstruk

v1.15.0

xorbitsai/inferencev1.15.0Dec 13, 2025by XprobeBot

AI Summary

This release adds support for DeepSeek-V3.2, PaddleOCR-VL, Z-Image-Turbo models, introduces multi-replica on single GPU with launch strategy, and enhances tool calls support.

Key Highlights

  • Support DeepSeek-V3.2 model
  • Support PaddleOCR-VL model
  • Support Z-Image-Turbo model
  • Multi replicas on a single GPU with launch strategy
  • Add llama_cpp json schema output

New Features

  • Support Z-Image-Turbo
  • Support DeepSeek-V3.2
  • Support PaddleOCR-VL
  • Add llama_cpp json schema output
  • Multi replicas on a single GPU with launch strategy

Full Release Notes

# What's new in 1.15.0 (2025-12-13)
These are the changes in inference v1.15.0.
## New features
* FEAT: added more detailed instructions for engine unavailability. by @OliverBryant in https://github.com/xorbitsai/inference/pull/4308
* FEAT: [model] Z-Image-Turbo support by @OliverBryant in https://github.com/xorbitsai/inference/pull/4333
* FEAT: [model] DeepSeek-V3.2 support by @Jun-Howie in https://github.com/xorbitsai/inference/pull/4344
* FEAT: [model] PaddleOCR-VL support by @leslie2046 in https://github.com/xorbitsai/inference/pull/4354
* FEAT: add llama_cpp json schema output by @OliverBryant in https://github.com/xorbitsai/inference/pull/4282
* FEAT: PaddleOCR-VL implementation by @leslie2046 in https://github.com/xorbitsai/inference/pull/4304
* FEAT: multi replicas on a single GPU && add launch strategy by @OliverBryant in https://github.com/xorbitsai/inference/pull/4358
## Enhancements
* ENH: update models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4343
* ENH: update model "MiniMax-M2" JSON by @XprobeBot in https://github.com/xorbitsai/inference/pull/4342
* ENH: update models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4349
* ENH: support lauching with --device cpu by @hubutui in https://github.com/xorbitsai/inference/pull/4352
* ENH: add glm-4.5 tool calls support && vllm StructuredOutputsParams support by @OliverBryant in https://github.com/xorbitsai/inference/pull/4357
## Bug fixes
* BUG: fix manage cache models missing by @OliverBryant in https://github.com/xorbitsai/inference/pull/4329
* BUG: [llm, vllm]: support ignore eos by @ZhikaiGuo960110 in https://github.com/xorbitsai/inference/pull/4332
* BUG: Multimodal settings for video parameters are not taking effect. by @OliverBryant in https://github.com/xorbitsai/inference/pull/4338
* BUG: Soft links cannot be completely deleted by @OliverBryant in https://github.com/xorbitsai/inference/pull/4337
* BUG: Packages with identical names in virtual environments error by @OliverBryant in https://github.com/xorbitsai/inference/pull/4348
* BUG: Fix typo in xinference/deploy/docker/Dockerfile.cu128 by @hubutui in https://github.com/xorbitsai/inference/pull/4350
* BUG: custom embedding model register fail by @OliverBryant in https://github.com/xorbitsai/inference/pull/4335
* BUG: [UI] fix the bug in the copy function. by @yiboyasss in https://github.com/xorbitsai/inference/pull/4355
* BUG: [UI] control Select dropdown width to prevent it from becoming too wide. by @yiboyasss in https://github.com/xorbitsai/inference/pull/4356
## Documentation
* DOC: add new models and v1.14.0 release notes by @qinxuye in https://github.com/xorbitsai/inference/pull/4305
## Others
* Fixed- workflow Vulnerability by @barakharyati in https://github.com/xorbitsai/inference/pull/4328
* CHORE: add i18n for replica details by @leslie2046 in https://github.com/xorbitsai/inference/pull/4306

## New Contributors
* @barakharyati made their first contribution in https://github.com/xorbitsai/inference/pull/4328
* @ZhikaiGuo960110 made their first contribution in https://github.com/xorbitsai/inference/pull/4332
* @hubutui made their first contribution in https://github.com/xorbitsai/inference/pull/4350

**Full Changelog**: https://github.com/xorbitsai/inference/compare/v1.14.0...v1.15.0