Starstruk Logo MarkStarstruk

v1.12.0

xorbitsai/inferencev1.12.0Nov 2, 2025by XprobeBot

AI Summary

This release adds support for jina-reranker-v3, qwen3-omni, and DeepSeek-OCR models, introduces OCR gradio UI, and adds Python 3.13 support.

Key Highlights

  • Support jina-reranker-v3
  • Support qwen3-omni
  • Support DeepSeek-OCR
  • Add OCR gradio UI
  • Support Python 3.13

New Features

  • Support jina-reranker-v3
  • Support qwen3-omni
  • Support Python 3.13
  • Add OCR gradio UI
  • Support DeepSeek-OCR

Full Release Notes

# What's new in 1.12.0 (2025-11-02)
These are the changes in inference v1.12.0.
## New features
* FEAT: [model] support jina-reranker-v3 by @llyycchhee in https://github.com/xorbitsai/inference/pull/4156
* FEAT: [model] qwen3-omni by @qinxuye in https://github.com/xorbitsai/inference/pull/4137
* FEAT: xinference python 3.13 support by @OliverBryant in https://github.com/xorbitsai/inference/pull/4164
* FEAT: add OCR gradio UI by @OliverBryant in https://github.com/xorbitsai/inference/pull/4185
* FEAT: [model] DeepSeek-OCR by @OliverBryant in https://github.com/xorbitsai/inference/pull/4187
## Enhancements
* ENH: adding lightning support for qwen-image-edit-2509 by @qinxuye in https://github.com/xorbitsai/inference/pull/4151
* BLD: torchaudio 2.9 introduces the breaking change in torchaudio.save by @qiulang in https://github.com/xorbitsai/inference/pull/4178
* BLD: fix setup.cfg for python 3.12 and fix dockerfile by @zwt-1234 in https://github.com/xorbitsai/inference/pull/4192
* BLD: fix Dockerfile.cpu by @zwt-1234 in https://github.com/xorbitsai/inference/pull/4195
* REF: Modified the batch lock logic by @OliverBryant in https://github.com/xorbitsai/inference/pull/4162
* BLD: fix transformers version in cu128 dockerfile by @zwt-1234 in https://github.com/xorbitsai/inference/pull/4152
## Bug fixes
* BUG: repair qwen3 model transformers random characters by @OliverBryant in https://github.com/xorbitsai/inference/pull/4148
* BUG: [UI] resolve progress bar display issue. by @yiboyasss in https://github.com/xorbitsai/inference/pull/4150
* BUG: fix IndexTTS2 on transformes 4.57.1 by @OliverBryant in https://github.com/xorbitsai/inference/pull/4158
* BUG: fix error when xinference run on docker with oath2 by @OliverBryant in https://github.com/xorbitsai/inference/pull/4161
* BUG: fix qwen3-vl launch error by @amumu96 in https://github.com/xorbitsai/inference/pull/4190
## Documentation
* DOC: add release notes doc by @qinxuye in https://github.com/xorbitsai/inference/pull/4157
* DOC: Add PyPI mirror configuration guide for audio package installation by @qiulang in https://github.com/xorbitsai/inference/pull/4177
## Others
* chore: sync models JSON [image, llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4149
* chore: sync models JSON [rerank] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4159
* chore: sync models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4160
* chore: sync models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4171
* chore: sync models JSON [image] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4186
* chore: sync models JSON [embedding, image] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4188
* chore: sync models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4191


**Full Changelog**: https://github.com/xorbitsai/inference/compare/v1.11.0...v1.12.0