Starstruk Logo MarkStarstruk

v1.11.0

xorbitsai/inferencev1.11.0Oct 19, 2025by XprobeBot

AI Summary

This release introduces comprehensive support for Qwen3 models, OpenAI image edit API, and vLLM multi-model capabilities, along with various enhancements and bug fixes.

Key Highlights

  • Added Qwen3-4B Instruct/Thinking model support
  • Implemented OpenAI image edit API support
  • Added vLLM multi-model support
  • Enhanced vLLM AWQ 8bit and Qwen3-VL 30B support
  • Added MiniCPM-V-4.5 model support

New Features

  • Qwen3-4B Instruct/Thinking model support
  • OpenAI image edit API support
  • vLLM multi-model support
  • vLLM AWQ 8bit support
  • Qwen3-VL 30B support
  • MiniCPM-V-4.5 model support

Full Release Notes

# What's new in 1.11.0 (2025-10-19)
These are the changes in inference v1.11.0.
## New features
* FEAT: [model]Support Qwen3-4B Instruct/Thinking by @Jun-Howie in https://github.com/xorbitsai/inference/pull/4129
* FEAT: OpenAI image edit api support by @OliverBryant in https://github.com/xorbitsai/inference/pull/4110
* FEAT: Add vllm multi model support by @zhcn000000 in https://github.com/xorbitsai/inference/pull/4126
## Enhancements
* ENH: Add  support for vllm awq 8bit and support qwen3-vl 30b by @zhcn000000 in https://github.com/xorbitsai/inference/pull/4122
* BLD: Fix CI run failed issue by @OliverBryant in https://github.com/xorbitsai/inference/pull/4103
* BLD: fix cu128 Dockerfile by @zwt-1234 in https://github.com/xorbitsai/inference/pull/4145
## Bug fixes
* BUG: [UI] launch button stays disabled when n_gpu_layers=-1. by @yiboyasss in https://github.com/xorbitsai/inference/pull/4127
* BUG: vllm structured output issue by @OliverBryant in https://github.com/xorbitsai/inference/pull/4142
## Documentation
* DOC: update new models by @qinxuye in https://github.com/xorbitsai/inference/pull/4146
## Others
* BLD：Docker.cu128 Upgrade VLLM to 0.10.2 by @zwt-1234 in https://github.com/xorbitsai/inference/pull/4134
* FEAT：[model] support MiniCPM-V-4.5 by @OliverBryant in https://github.com/xorbitsai/inference/pull/4136
* chore: sync models JSON [audio, image, llm, video] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4135
* chore: sync models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4140

## New Contributors
* @XprobeBot made their first contribution in https://github.com/xorbitsai/inference/pull/4135

**Full Changelog**: https://github.com/xorbitsai/inference/compare/v1.10.1...v1.11.0