v0.14.0

vllm-project/vllm-omniv0.14.0Jan 31, 2026by david6666666

AI Summary

v0.14.0 is a feature-heavy release expanding diffusion/image-video generation and audio/TTS stacks. It features async chunk, stage-based deployment for Bagel, Qwen3-TTS support, Diffusion LoRA Adapter Support, DiT layerwise CPU offloading, and hardware platforms.

Key Highlights

  • Async chunk pipeline overlap across stages to reduce idle time.
  • Stage-based deployment for the Bagel model.
  • Qwen3-TTS model family support and online serving.
  • Diffusion LoRA Adapter Support (PEFT-compatible).
  • DiT layerwise (blockwise) CPU offloading.
  • Hardware platforms + plugin system.

New Features

  • Added Stable Audio Open support for text-to-audio generation.
  • Added GLM-Image support.
  • Added FLUX.1-dev support.
  • Added FLUX.2-klein support.
  • Added Qwen3-TTS model series support.
  • Added Bagel Model support.
  • Added XPU Backend support.

Full Release Notes

## Highlights
This release features approximately 180 commits from over 70 contributors (23 new contributors).

vLLM-Omni **v0.14.0** is a feature-heavy release that expands Omni’s **diffusion / image-video generation** and **audio / TTS** stack, improves **distributed execution and memory efficiency**, and broadens **platform/backend coverage** (GPU/ROCm/NPU/XPU). It also brings meaningful upgrades to **serving APIs**, **profiling & benchmarking**, and overall **stability**.

### Key Improvements:

* **Async chunk** ([#727]): chunk pipeline overlap across stages to reduce idle time and improve end-to-end throughput/latency for staged execution.
* **Stage-based deployment for the Bagel model** ([#726]): Multi-stage pipeline (Thinker/AR stage + Diffusion/DiT stage) aligning it with the vllm-omni architecture
* **Qwen3-TTS model family support** ([#895]): Expands text-to-audio generation and supports online serving.
* **Diffusion LoRA Adapter Support (PEFT-compatible)** ([#758]): Adds LoRA fine-tuning/adaptation for diffusion workflows with a PEFT-aligned interface.
* **DiT layerwise (blockwise) CPU offloading** ([#858]): Fine-grained offloading to increase memory headroom for larger diffusion runs.
* **Hardware platforms + plugin system** ([#774]): Establishes a more extensible platform capability layer for cleaner multi-backend development.

---

### Diffusion & Image/Video Generation

* **Sequence Parallelism (SP) foundations + expansion**: Adds a non-intrusive SP abstraction for diffusion models ([#779]), SP support in LongCatImageTransformer ([#721]), and SP support for Wan2.2 diffusion ([#966]).
* **CFG improvements and parallelization**: CFG parallel support for Qwen-Image ([#444]), CFG parallel abstraction ([#851]), and online-serving CFG parameter support ([#824]).
* **Acceleration & execution plumbing**: Torch compile support for diffusion ([#684]), GPU diffusion runner ([#822]), and diffusion executor ([#865]).
* **Caching and memory efficiency**: TeaCache for Z-Image ([#817]) and TeaCache for Bagel ([#848]); plus CPU offloading for diffusion ([#497]) and DiT tensor parallel enablement for diffusion pipeline (Z-Image) ([#735]).
* **Model coverage expansion**: Adds GLM-Image support ([#847]), FLUX family additions (e.g., FLUX.1-dev [#853], FLUX.2-klein [#809]) and related TP support ([#973]).
* **Quality/stability fixes for pipelines**: Multiple diffusion pipeline correctness fixes (e.g., CFG parsing failure fix [#922], SD3 compatibility fix [#772], video saving bug under certain fps [#893], noisy output without a seed in Qwen Image [#1043]).

---

### Audio & Speech (TTS / Text-to-Audio)

* **Text-to-audio model support**: Stable Audio Open support for text-to-audio generation ([#331]).
* **Qwen3-TTS stack maturation**: Model series support ([#895]), online serving support ([#968]), plus stabilization fixes such as profile-run hang resolution ([#1082]) and dependency additions for Qwen3-TTS support ([#981]).
* **Interoperability & correctness**: Fixes and improvements across audio outputs and model input validation (e.g., StableAudio output standardization [#842], speaker/voices loading from config [#1079]).

---

### Serving, APIs, and Frontend

* **Diffusion-mode service endpoints & compatibility**: Adds /health and /v1/models endpoints for diffusion mode and fixes streaming compatibility ([#454]).
* **New/expanded image APIs**: /v1/images/edit interface ([#1101]).
* **Online serving usability improvements**: Enables tensor_parallel_size argument with online serving command ([#761]) and supports CFG parameters in online serving ([#824]).
* **Batching & request handling**: Frontend/model support for batch requests (OmniDiffusionReq refinement) ([#797]).

---

### Performance & Efficiency

* **Qwen3-Omni performance work**: SharedFusedMoE integration ([#560]), fused QKV & projection optimizations (e.g., fuse QKV linear and gate_up proj [#734], Talker MTP optimization [#1005]).
* **Attention and kernel/backend tuning**: Flash Attention attention-mask support ([#760]), FA3 backend defaults when supported ([#783]), and ROCm performance additions like AITER Flash Attention ([#941]).
* **Memory-aware optimizations**: Conditional transformer loading for Wan2.2 to reduce memory usage ([#980]).

---

### Hardware / Backends / CI Coverage

* **Broader backend support**: XPU backend support ([#191]) plus the platform/plugin system groundwork ([#774]).
* **NPU & ROCm updates**: NPU upgrade alignment ([#820], [#1114]) and ROCm CI expansion / optimization ([#542], [#885], [#1039]).
* **Test reliability / coverage**: CI split to avoid timeouts ([#883]) and additional end-to-end / precision tests (e.g., chunk e2e tests [#956]).

---

### Reliability, Correctness, and Developer Experience

* **Stability fixes across staged execution and serving**: Fixes for stage config loading issues ([#860]), stage output mismatch in online batching ([#691]), and server readiness wait-time increase for slow model loads ([#1089]).
* **Profiling & benchmarking improvements**: Diffusion profiler support ([#709]) plus benchmark additions (e.g., online benchmark [#780]).
* **Documentation refresh**: Multiple diffusion docs refactors and new guides (e.g., profiling guide [#738], torch profiler guide [#570], diffusion docs refactor [#753], ROCm instructions updates [#678], [#905]).

---

## What's Changed
* [Docs] Fix diffusion module design doc by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/645
* [Docs] Remove multi-request streaming design document and update ray-based execution documentation structure by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/641
* [Bugfix] Fix TI2V-5B weight loading by loading transformer config from model by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/633
* Support sleep, wake_up and load_weights for Omni Diffusion by @knlnguyen1802 in https://github.com/vllm-project/vllm-omni/pull/376
* [Misc] Merge diffusion forward context by @iwzbi in https://github.com/vllm-project/vllm-omni/pull/582
* [Doc] User guide for torch profiler  by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/570
* [Docs][NPU] Upgrade to v0.12.0 by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/656
* [BugFix] token2wav code out of range by @Bounty-hunter in https://github.com/vllm-project/vllm-omni/pull/655
* [Doc] Update version 0.12.0 by @ywang96 in https://github.com/vllm-project/vllm-omni/pull/662
* [Docs] Update diffusion_acceleration.md by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/659
* [Docs] Guide for using sleep mode and enable sleep mode by @knlnguyen1802 in https://github.com/vllm-project/vllm-omni/pull/660
* [Diffusion][Feature] CFG parallel support for Qwen-Image by @wtomin in https://github.com/vllm-project/vllm-omni/pull/444
* [BUGFIX] Delete the CUDA context in the stage process. by @fake0fan in https://github.com/vllm-project/vllm-omni/pull/661
* [Misc] Fix docs display problem of streaming mode and other related issues by @Gaohan123 in https://github.com/vllm-project/vllm-omni/pull/667
* [Model] Add Stable Audio Open support for text-to-audio generation by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/331
* [Doc] Update ROCm getting started instruction by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/678
* [Bugfix] Fix f-string formatting in image generation pipelines by @ApsarasX in https://github.com/vllm-project/vllm-omni/pull/689
* [Bugfix] Solve Ulysses-SP sequence length not divisible by SP degree (using padding and attention mask) by @wtomin in https://github.com/vllm-project/vllm-omni/pull/672
* omni entrypoint support tokenizer arg by @divyanshsinghvi in https://github.com/vllm-project/vllm-omni/pull/572
* [Bug fix] fix e2e_total_tokens and e2e_total_time_ms by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/648
* [BugFix] Explicitly release file locks during stage worker init by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/703
* [BugFix] Fix stage engine outputs mismatch bug in online batching by @ZeldaHuang in https://github.com/vllm-project/vllm-omni/pull/691
* [core] add torch compile for diffusion by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/684
* [BugFix] Remove duplicate width assignment in SD3 pipeline by @dongbo910220 in https://github.com/vllm-project/vllm-omni/pull/708
* [Feature] Support Qwen3 Omni talker cudagraph by @ZeldaHuang in https://github.com/vllm-project/vllm-omni/pull/669
* [Benchmark] DiT Model Benchmark under Mixed Workloads by @asukaqaq-s in https://github.com/vllm-project/vllm-omni/pull/529
* update design doc by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/711
* [Perf] Use vLLM's SharedFusedMoE in Qwen3-Omni by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/560
* [Doc]: update vllm serve param and base64 data truncation by @nuclearwu in https://github.com/vllm-project/vllm-omni/pull/718
* [BugFix] Fix assuming all stage model have talker by @princepride in https://github.com/vllm-project/vllm-omni/pull/730
* [Perf][Qwen3-Omni] Fuse QKV linear and gate_up proj by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/734
* [Feat] Enable DiT tensor parallel for Diffusion Pipeline(Z-Image) by @dongbo910220 in https://github.com/vllm-project/vllm-omni/pull/735
* [Bugfix] Fix multi-audio input shape alignment for Qwen3-Omni Thinker by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/697
* [ROCm] [CI] Add More Tests by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/542
* [Docs] update design doc templated in RFC by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/746
* Add description of code version for bug report by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/745
* [misc] fix rfc template by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/748
* fix:#issue 432 by @GG-li in https://github.com/vllm-project/vllm-omni/pull/517
* [Diffusion][Feature] Implement SP support in LongCatImageTransformer by @mxuax in https://github.com/vllm-project/vllm-omni/pull/721
* [Debug] Clean code in Qwen 3 Omni and add warning for talker temperature. by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/688
* [feature] cpu offloading support for diffusion by @LawJarp-A in https://github.com/vllm-project/vllm-omni/pull/497
* [Misc] Group omni arguments into OmniConfig section by @fake0fan in https://github.com/vllm-project/vllm-omni/pull/744
* [Misc] Enable tensor_parallel_size argument with online serving cmd by @JustQJ in https://github.com/vllm-project/vllm-omni/pull/761
* [Bugfix] Raise ValueError when joint_strategy='rear' and causal=True in Ring Attention by @mxuax in https://github.com/vllm-project/vllm-omni/pull/767
* [Feat] add vllm-omni version collection by @sihyeonn in https://github.com/vllm-project/vllm-omni/pull/740
* [Doc] refactor diffusion doc by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/753
* [Bugfix] Fix stable diffusion3 compatibility error by @iwzbi in https://github.com/vllm-project/vllm-omni/pull/772
* [Feature] Support Qwen3 Omni talker mtp batch inference by @ZeldaHuang in https://github.com/vllm-project/vllm-omni/pull/722
* [BugFix]Remove duplicate error handling for request results by @liuyuhanalex in https://github.com/vllm-project/vllm-omni/pull/781
* [CI] Add pytest markers in config files. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/719
* [Doc] Fix mkdocs. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/785
* [Bugfix] Fix generation artifacts of Qwen-Image-Edit-2511 and update pipeline DiT param parsing  by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/776
* [bugfix] Fix Wan2.2 I2V warmup failure by adding support_image_input attribute by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/791
* [Misc] add wechat group and star history on README by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/801
* [BugFix] Fix incorrect mrope positions under cuda graph by @ZeldaHuang in https://github.com/vllm-project/vllm-omni/pull/803
* [BugFix] Qwen2.5-omni supress end token and won't stop by @yinpeiqi in https://github.com/vllm-project/vllm-omni/pull/773
* [Feature] Flash Attention to Support Attention Mask by @wtomin in https://github.com/vllm-project/vllm-omni/pull/760
* [Model] add flux2 klein by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/809
* [bugfix] use unipc scheduler for Wan 2.2 by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/804
* [Test] Add full test for Qwen3-Omni-30B-A3B-Instruct by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/720
* [Bagel] Support Cache-Dit by @princepride in https://github.com/vllm-project/vllm-omni/pull/736
* [Perf] Optimize the Qwen2.5-Omni Model thinker-to-talker-proj with nn.Linear by @kechengliu97 in https://github.com/vllm-project/vllm-omni/pull/825
* [Core]Add GPU Diffusion Runner by @princepride in https://github.com/vllm-project/vllm-omni/pull/822
* [Feature]: Add CFG param to online serving by @gDINESH13 in https://github.com/vllm-project/vllm-omni/pull/824
* [diffusion] add tp support for qwen-image and refactor some tests by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/830
* [Core] Implement Diffusion Profiler Support by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/709
* [Bugfix] Diffusion model fails to load when stage config is present by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/860
* chore: Bump up cache-dit and fix docs links by @DefTruth in https://github.com/vllm-project/vllm-omni/pull/863
* [Misc] Change benchmark default port by @NickLucche in https://github.com/vllm-project/vllm-omni/pull/872
* Dev/rebase 0.14.0 and Support GLM-Image by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/847
* [Doc] Add user guide for diffusion model profiling by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/738
* [Doc] Update rebase doc by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/878
* [Test] Add full test for Qwen3-Omni-30B-A3B-Instruct for image and audio single modal by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/827
* [Diffusion] Non-Intrusive Sequence Parallelism (SP) Model Support Abstraction for vLLM-Omni Framework by @mxuax in https://github.com/vllm-project/vllm-omni/pull/779
* [Bugfix] Remove the duplicate api registration in vllm-omni by @fake0fan in https://github.com/vllm-project/vllm-omni/pull/880
* [CI] split tests to avoid timeout by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/883
* [Diffusion][Acceleration] Support TeaCache for Z-Image by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/817
* [Perf] Fuse Q/K/V Linear with QKVParallelLinear in Qwen2.5Omni DiTAttention by @kechengliu97 in https://github.com/vllm-project/vllm-omni/pull/884
* [bugfix] support text + audio mixed output by @GG-li in https://github.com/vllm-project/vllm-omni/pull/843
* [Misc] fix qwen image family redundant computation by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/868
* [ROCm] [CI] Optimize Dockerfilerocm and reduce build time on CI by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/885
* [Core]Add Diffusion executor by @natureofnature in https://github.com/vllm-project/vllm-omni/pull/865
* [Bugfix] Fix video saving bug under certain fps by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/893
* [diffusion] use fa3 by default when device supports it by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/783
* [Model] Support Qwen3-TTS model series by @Gaohan123 in https://github.com/vllm-project/vllm-omni/pull/895
* Support Bagel Model by @princepride in https://github.com/vllm-project/vllm-omni/pull/726
* debug Qwen TTS by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/902
* [ROCm] [Doc] Add instructions to install ROCm dependencies to run Qwen3 TTS model by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/905
* Bump version to 0.14.0rc1 by @ywang96 in https://github.com/vllm-project/vllm-omni/pull/910
* [Doc] Fix the version in the documentation to v0.14.0rc1; fix dockerfile.rocm entrypoint by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/913
* [Misc] update wechat image by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/914
* [Test] Add precision test cases for Qwen3-Omni-30B-A3B-Instruct in CI by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/828
* [Misc] Fix error log for the diffusion stage timeout by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/915
* [bugfix] qwen3-tts check_model_inputs by @qibaoyuan in https://github.com/vllm-project/vllm-omni/pull/924
* [Misc] Fix t2i online serving example by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/928
* [examples] add --enable-cpu-offload args by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/930
* [BugFix] Standardize StableAudio audio output by @LudovicoYIN in https://github.com/vllm-project/vllm-omni/pull/842
* [Bagel] Support TeaCache by @princepride in https://github.com/vllm-project/vllm-omni/pull/848
* [Doc] Add Bagel model support to TeaCache documentation by @nussejzz in https://github.com/vllm-project/vllm-omni/pull/943
* [Bugfix] raise error in diffusion engine and fix offload test by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/933
* [Feature]Support async computation and communication across stages by chunks by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/727
* [Bugfix] Fix diffusion pipeline CFG (guidance_scale parsing failure bug) by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/922
* [doc]Add Text-To-Audio Readme documentation by @zzhuoxin1508 in https://github.com/vllm-project/vllm-omni/pull/958
* [Feature] Diffusion LoRA Adapter Support (PEFT compatible) for vLLM alignment by @AndyZhou952 in https://github.com/vllm-project/vllm-omni/pull/758
* [Diffusion][Feature] Non-Intrusive Sequence Parallelism (SP) Support for Wan2.2 by @mxuax in https://github.com/vllm-project/vllm-omni/pull/966
* [doc] add some additional information for the diffusion model support by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/952
* [Perf] avoid cpu op in QwenImageCrossAttention by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/942
* Support Qwen3 tts online serving by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/968
* [test] fix test_image_generation_lora CI timeout by @AndyZhou952 in https://github.com/vllm-project/vllm-omni/pull/975
* [diffusion] add tp for FLUX.2-klein by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/973
* [test] revert test flash attn file by @AndyZhou952 in https://github.com/vllm-project/vllm-omni/pull/972
* [NPU] Upgrade to v0.14.0 by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/820
* [ROCm] [Perf] Add AITER Flash Attention by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/941
* [Test] Add chunk e2e test case for CI by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/956
* [Feature] Implement YuanrongConnector based on OmniConnectorBase by @yangsonglin13 in https://github.com/vllm-project/vllm-omni/pull/716
* [NFC] Remove redundant torch.no_grad in models and pipelines by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/854
* [BugFix] Modify the method of obtaining external_request_id by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/961
* Fix TTS speaker typo and add supported languages by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/990
* [Fix] make images LoRA e2e less flaky by @dongbo910220 in https://github.com/vllm-project/vllm-omni/pull/978
* [Docs] Fix GLM-Image docstring indentation to resolve CI failure by @dongbo910220 in https://github.com/vllm-project/vllm-omni/pull/992
* [Perf] replace torch's conv with vLLM's conv to fix torch 2.9 performance regression by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/982
* [BugFix] Add /health and /v1/models endpoints for diffusion mode, fix streaming compatibility by @majiayu000 in https://github.com/vllm-project/vllm-omni/pull/454
* [Bugfix] Add missing dependencies (onnxruntime, sox) for Qwen3-TTS support by @zzhuoxin1508 in https://github.com/vllm-project/vllm-omni/pull/981
* [Frontend][Model] Support batch request with refined OmniDiffusionReq… by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/797
* [Model]: add FLUX.1-dev model by @nuclearwu in https://github.com/vllm-project/vllm-omni/pull/853
* [BugFix] ignore mm data from stages to async omni by @Bounty-hunter in https://github.com/vllm-project/vllm-omni/pull/954
* Revert "[BugFix] ignore mm data from stages to async omni" by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/1023
* [Bugfix] Modify output to model_runner_output by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1026
* [Feature] Support cache-dit for Wan 2.2 inference by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/1021
* [Doc]Format profiling doc by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/993
* [Hardware] Support platforms and plugin system by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/774
* [Core]: KV Cache Transfer Encapsulation by @princepride in https://github.com/vllm-project/vllm-omni/pull/979
* [Test]Delete skip mark for amd ci test and fix CI failure by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/927
* [Bugfix][Doc]Specify Qwen3-TTS model name for each task type by @kylehh in https://github.com/vllm-project/vllm-omni/pull/1036
* [Misc] pin version of fa3-fwd by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/1051
* [CI] [ROCm] Add more AMD CI tests by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/1039
* [Bugfix] fix qwen image layerd in dummy run by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/1027
* [BugFix] Fix noisy output without setting a seed in Qwen Image by @natureofnature in https://github.com/vllm-project/vllm-omni/pull/1043
* [bugfix] remove vllm speech route by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1060
* [Debug] Update GLM-Image Pipeline by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1049
* [Diffusion][Bugfix] Fix the flash_attn backends selection logic by @mxuax in https://github.com/vllm-project/vllm-omni/pull/983
* [BugFix] Fix the accuracy issue of multimodal input. by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/1020
* [Bugfix] Set VaeImageProcessor `do_convert_rgb` True by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1032
* [feat]: adapt batch request for flux by @nuclearwu in https://github.com/vllm-project/vllm-omni/pull/1028
* [CI] Change Qwen3 Omni stage placement strategy  by @ZeldaHuang in https://github.com/vllm-project/vllm-omni/pull/1072
* [BugFix] Fix to use correct attn backend by @divyanshsinghvi in https://github.com/vllm-project/vllm-omni/pull/1038
* [Perf] Qwen3 Omni talker mtp optimization by @ZeldaHuang in https://github.com/vllm-project/vllm-omni/pull/1005
* [Wan2.2] Optimize memory usage with conditional transformer loading by @faaany in https://github.com/vllm-project/vllm-omni/pull/980
* [Feat] Support XPU Backend in vLLM-Omni by @faaany in https://github.com/vllm-project/vllm-omni/pull/191
* [Fix] stabilize diffusion images LoRA E2E across CI drift by @dongbo910220 in https://github.com/vllm-project/vllm-omni/pull/1075
* [Bugfix][Test] Re-enable the log simple tests by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1065
* [Bugfix] pr conflict fix, bugfix ignore mm data from stages to async omni by @Bounty-hunter in https://github.com/vllm-project/vllm-omni/pull/1025
* [Doc][Bagel] Add BAGEL-7B-MoT documentation and edit the default stage configuration by @nussejzz in https://github.com/vllm-project/vllm-omni/pull/987
* [Fix] Increase max wait time for server readiness to accommodate model loading by @AndyZhou952 in https://github.com/vllm-project/vllm-omni/pull/1089
* [Benchmark] Add vLLM-Omni Omni model online benchmark by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/780
* [Bugfix] Remove Mooncake/Yuanrong connector import warning by @natureofnature in https://github.com/vllm-project/vllm-omni/pull/1091
* fix: UnboundLocalError for role in streaming audio/image responses by @PierreLeGuen in https://github.com/vllm-project/vllm-omni/pull/784
* [Misc] update wechat image by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1096
* [Feature] Support DiT Layerwise (Blockwise) CPU Offloading by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/858
* [BugFix] Modify max_tokens and modify the log and fix #1103 by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/1097
* [BugFix] Fix modulate_index shape error in Qwen-Image-Edit Task by @mxuax in https://github.com/vllm-project/vllm-omni/pull/1100
* [Platform] Add supports_torch_inductor interface by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1108
* [BugFix] Fix Qwen3 Omni talker mtp torch.compile startup error by @ZeldaHuang in https://github.com/vllm-project/vllm-omni/pull/1104
* [Bugfix] fix request_id of image generation in api server by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/1112
* [Perf]: CFG parallel abstraction by @wtomin in https://github.com/vllm-project/vllm-omni/pull/851
* [BugFix] Fix Qwen3 TTS 0.6B profile run hang (#995) by @marksverdhei in https://github.com/vllm-project/vllm-omni/pull/1082
* [CI] [ROCm] Quick fix amd ci by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/1116
* [Bugfix] fix benchmark audio timing error and add benchmark test by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1109
* [Bugfix][Qwen3TTS] Load speaker_id/voices from model configuration by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/1079
* [NPU] Align with GPUModelRunner by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1114
* [FEATURE] /v1/images/edit interface by @Bounty-hunter in https://github.com/vllm-project/vllm-omni/pull/1101
* [Bugfix] Fix NPU SDPA attention mask shape and semantics by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1031

## New Contributors
* @ApsarasX made their first contribution in https://github.com/vllm-project/vllm-omni/pull/689
* @dongbo910220 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/708
* @asukaqaq-s made their first contribution in https://github.com/vllm-project/vllm-omni/pull/529
* @nuclearwu made their first contribution in https://github.com/vllm-project/vllm-omni/pull/718
* @yenuo26 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/745
* @GG-li made their first contribution in https://github.com/vllm-project/vllm-omni/pull/517
* @JustQJ made their first contribution in https://github.com/vllm-project/vllm-omni/pull/761
* @sihyeonn made their first contribution in https://github.com/vllm-project/vllm-omni/pull/740
* @liuyuhanalex made their first contribution in https://github.com/vllm-project/vllm-omni/pull/781
* @kechengliu97 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/825
* @gDINESH13 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/824
* @NickLucche made their first contribution in https://github.com/vllm-project/vllm-omni/pull/872
* @LudovicoYIN made their first contribution in https://github.com/vllm-project/vllm-omni/pull/842
* @nussejzz made their first contribution in https://github.com/vllm-project/vllm-omni/pull/943
* @amy-why-3459 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/727
* @zzhuoxin1508 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/958
* @AndyZhou952 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/758
* @yangsonglin13 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/716
* @majiayu000 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/454
* @kylehh made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1036
* @PierreLeGuen made their first contribution in https://github.com/vllm-project/vllm-omni/pull/784
* @marksverdhei made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1082
* @JuanPZuluaga made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1079

**Full Changelog**: https://github.com/vllm-project/vllm-omni/compare/v0.12.0rc1...v0.14.0