Starstruk Logo MarkStarstruk

v2.1.0

xorbitsai/inferencev2.1.0Feb 14, 2026by XprobeBot

AI Summary

Release v2.1.0 adds support for multiple new models including GLM-4.7, FLUX.2-klein, Qwen3-ASR, and MinerU2.5. Includes bug fixes for vllm embedding/reranker models and refactoring of API schemas into domain-specific modules.

Key Highlights

  • GLM-4.7 and GLM-4.7-Flash model support
  • FLUX.2-klein-4B and FLUX.2-klein-9B image generation support
  • Qwen3-ASR-0.6B and Qwen3-ASR-1.7B speech recognition models
  • MinerU2.5-2509-1.2B OCR model support
  • Bug fixes for vllm embedding and reranker model errors
  • Refactored Pydantic request schemas and route registration

New Features

  • GLM-4.7
  • GLM-4.7-Flash
  • MinerU2.5-2509-1.2B
  • Qwen3-ASR-0.6B
  • Qwen3-ASR-1.7B
  • FLUX.2-klein-4B
  • FLUX.2-klein-9B

Full Release Notes

# What's new in 2.1.0 (2026-02-14)
These are the changes in inference v2.1.0.
## New features
* FEAT: [model] GLM-4.7 support by @Jun-Howie in https://github.com/xorbitsai/inference/pull/4565
* FEAT: [model] MinerU2.5-2509-1.2B removed by @OliverBryant in https://github.com/xorbitsai/inference/pull/4568
* FEAT: [model] GLM-4.7-Flash support by @OliverBryant in https://github.com/xorbitsai/inference/pull/4578
* FEAT: [model] Qwen3-ASR-0.6B support by @leslie2046 in https://github.com/xorbitsai/inference/pull/4579
* FEAT: [model] Qwen3-ASR-1.7B support by @leslie2046 in https://github.com/xorbitsai/inference/pull/4580
* FEAT: added support qwen3-asr models by @leslie2046 in https://github.com/xorbitsai/inference/pull/4581
* FEAT: [model] MinerU2.5-2509-1.2B support by @GaoLeiA in https://github.com/xorbitsai/inference/pull/4569
* FEAT: [model] FLUX.2-klein-4B support by @lazariv in https://github.com/xorbitsai/inference/pull/4602
* FEAT: [model] FLUX.2-klein-9B support by @lazariv in https://github.com/xorbitsai/inference/pull/4603
* FEAT: Add support for FLUX.2-Klein-9B and -4B models by @lazariv in https://github.com/xorbitsai/inference/pull/4596
## Enhancements
* ENH: update model "DeepSeek-V3.2" JSON by @OliverBryant in https://github.com/xorbitsai/inference/pull/4563
* ENH: update model "DeepSeek-V3.2-Exp" JSON by @OliverBryant in https://github.com/xorbitsai/inference/pull/4567
* ENH: update models JSON [image] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4606
* BLD: constrain setuptools<82 in Docker images by @qinxuye in https://github.com/xorbitsai/inference/pull/4607
* REF: extract Pydantic request schemas from restful_api.py into xinference/api/schemas/ by @amumu96 in https://github.com/xorbitsai/inference/pull/4598
* REF: extract route registration into domain-specific routers/ by @amumu96 in https://github.com/xorbitsai/inference/pull/4600
## Bug fixes
* BUG: vllm embedding model error by @OliverBryant in https://github.com/xorbitsai/inference/pull/4562
* BUG: vllm reranker score error by @OliverBryant in https://github.com/xorbitsai/inference/pull/4573
* BUG: handle async tokenizer in vllm core by @ace-xc in https://github.com/xorbitsai/inference/pull/4577
* BUG: vllm reranker model gpu release error by @OliverBryant in https://github.com/xorbitsai/inference/pull/4575
## Documentation
* DOC: add v2.0.0 release by @qinxuye in https://github.com/xorbitsai/inference/pull/4566
## Others
* BUG：setuptools CI error by @OliverBryant in https://github.com/xorbitsai/inference/pull/4595

## New Contributors
* @ace-xc made their first contribution in https://github.com/xorbitsai/inference/pull/4577
* @GaoLeiA made their first contribution in https://github.com/xorbitsai/inference/pull/4569
* @lazariv made their first contribution in https://github.com/xorbitsai/inference/pull/4602

**Full Changelog**: https://github.com/xorbitsai/inference/compare/v2.0.0...v2.1.0