v0.16.0

vllm-project/vllm-omniv0.16.0Feb 28, 2026by david6666666

AI Summary

v0.16.0 is a major alignment and capability release rebasing onto upstream vLLM v0.16.0. It features Qwen3-Omni/Qwen3-TTS performance and correctness improvements, MiMo-Audio production support, Bagel acceleration and scalability, Diffusion distributed execution expansion, and Quantization for DiT.

Key Highlights

  • Rebase to upstream vLLM v0.16.0.
  • Qwen3-Omni performance and correctness improvements including cuda graph and async-chunk.
  • MiMo-Audio production Support with performance optimizations.
  • Qwen3-TTS production upgrades including disaggregated inference pipeline and streaming output.
  • Bagel acceleration & scalability with TP support and CFG capabilities.
  • Diffusion distributed execution expansion with TP/SP/HSDP support.
  • Quantization for DiT with FP8 and native GGUF support.

New Features

  • Added HunyuanImage3 support.
  • Added OmniGen2 support.
  • Added nextstep_1 diffusion model support.
  • Added Wan2.2 T2V and I2V Online Serving support.
  • Added MiMo-Audio-7B-Instruct support.

Full Release Notes

## Highlights
This release features approximately 121 commits (merged PRs) from ~60 contributors (24 new contributors).

vLLM-Omni v0.16.0 is a major alignment + capability release that rebases the project onto **upstream vLLM v0.16.0** and significantly expands performance, distributed execution, and production readiness across **Qwen3-Omni / Qwen3-TTS**, **Bagel**, **MiMo-Audio**, **GLM-Image** and the **Diffusion (DiT) image/video stack**—while also improving platform coverage (CUDA / ROCm / NPU / XPU), CI quality, and documentation. 

### Key Improvements

* **Rebase to upstream vLLM v0.16.0**: Tracks the latest vLLM runtime behavior and APIs while keeping Omni’s error handling aligned with upstream expectations. (#1357, #1122, plus follow-up fixes like #1401)
* **Qwen3-Omni performance + correctness**: Performance optimizations (cuda graph, async-chunk, streaming output) make TTFP reduced 90% and RTF 0.22~0.45, plus precision and E2E metric correctness fixes. (#1378, #1352, #1288, #1018, #1292)
* **MiMo-Audio production Support**: Performance optimizations  (cuda graph, async-chunk, streaming output) improves the RTF ~ 0.2, 11x faster than baseline. #750 
* **Qwen3-TTS production upgrades**: Disaggregated inference pipeline support, streaming output, batched Code2Wav decoding, and CUDA Graph support for speech tokenizer decoding—plus multiple robustness fixes across task type handling and voice cloning. (#1161, #1438, #1426, #1205, #1317, #1554)
* **Bagel acceleration & scalability**: Adds **TP support**, introduces **CFG** capabilities, and accelerates multi-branch CFG by **merging branches into a single batch**; includes KV transfer stability fixes. (#1293, #1310, #1429, #1437)
* **Diffusion distributed execution expansion**: Adds/extends TP/SP/HSDP and reduces redundant communication overhead; improves pipeline parallelism options (e.g., VAE patch parallel) and correctness across multiple diffusion families. (#964, #1275, #1339, #756, #1428)
* **Quantization for DiT**: Introduces **FP8** quantization support and **native GGUF quantization** support for diffusion transformers, with code-path cleanups. (#1034, #1285, #1533)
* **Broader model coverage (audio + image)**: Adds **MiMo-Audio-7B-Instruct** support and performance improvements for **GLM-Image** pipelines. (#750, #920)

---

### Diffusion, Image & Video Generation

* **New/expanded model coverage**

  * **HunyuanImage3** support and v0.16.0 follow-ups removing CUDA hardcoding + MOE fixes. (#1085, #1402, #1401)
  * **OmniGen2** support. (#513)
  * **nextstep_1** diffusion model (T2I-only). (#612)
* **Distributed & parallel execution**

  * **TP support** additions/expansions for diffusion models (e.g., Wan 2.2, SD 3.5). (#964, #1336)
  * **HSDP for diffusion models** for improved scalability. (#1339)
  * **VAE patch parallelism** support (and enablement for SD3.5). (#756, #1428)
  * **Sequence-parallel comm reduction** by refining SP hook design. (#1275)
* **Performance & memory efficiency**

  * Flux caching features (e.g., cache_dit) and **CFG-parallel** improvements for Flux.1-dev. (#1145, #1269)
  * Process-level memory calculation hooks for diffusion workloads. (#1276)
  * Platform-wide enablement of **layerwise offload**. (#1492)
* **Correctness & stability**

  * Multiple pipeline stability and correctness fixes (seed handling, attention mask dtype/shape, tokenizer padding issues, init/download safety, model detect robustness, etc.). (e.g., #1249, #1248, #1349, #1241, #1213, #1254, #1562)

---

### Audio, Speech & Omni (Qwen3-TTS / MiMo-Audio)

* **Qwen3-TTS feature set maturation**

  * Disaggregated inference pipeline support for stage-based / split deployment. (#1161)
  * **Streaming output** for `v1/audio/speech`-style workflows. (#1438)
  * **Code2Wav batched decoding** and async-chunk batch inference enhancements. (#1426, #1246)
  * CUDA Graph support for the speech tokenizer decoder. (#1205)
* **Stability & quality**

  * Fixes for task_type handling, snapshot/download behavior, configuration options, and voice clone corruption edge cases. (#1317, #1318, #1177, #1554, #1455)
  * More robust handling of **multimodal outputs that attach audio payloads** and related server-side audio data processing. (#1203, #1222)

---

### Multimodal Model Improvements

* **Bagel**

  * **TP support** for scaling across devices. (#1293)
  * **CFG enablement** and **multi-branch CFG merged into a single batch** to improve throughput and reduce per-branch overhead. (#1310, #1429)
  * KV transfer and stability fixes. (#1437)
* **GLM-Image**

  * **Performance improvements** for GLM-Image workloads. (#920)
  * Additional image-serving hardening that benefits GLM-Image deployments (endpoint/pipeline validation and crash fixes in edge cases). (e.g., #1141, #1265, #1248)

---

### Serving, APIs & Integrations

* **OpenAI-compatible video serving**

  * Adds **Wan2.2 T2V and I2V online serving** via OpenAI **`/v1/videos`** API. (#1073)
  * Supports irregular output shapes for Wan2.2. (#1279)
* **Online serving robustness & usability**

  * Unify CLI argument naming style and forward serve parameters more consistently to models. (#1309, #985)
  * Per-request `generator_device` for online image generation/edit flows. (#1183)
  * Fixes for image edit endpoint validation and RoPE crashes on explicit H/W. (#1141, #1265)
* **Ecosystem integration**

  * **ComfyUI integration** for improved workflow adoption. (#1113)

---

### Performance, Scheduling & Memory Accounting

* **Async chunk enhancements**

  * Overlap chunk I/O and compute via async scheduling to reduce idle time in chunked pipelines. (#951)
  * Async-chunk refactors and shape mismatch fixes for stability. (#1151, #1195)
* **Metrics & benchmarking**

  * Metrics structure optimization and multiple fixes for token/stream stats and E2E correctness (including Qwen3-Omni async-chunk E2E metric correctness). (#891, #1292, #1301, #1018)
  * Adds benchmarks for audio speech non-streaming and omni performance benchmark tests. (#1408, #1321)
* **Memory accounting**

  * **Process-scoped GPU memory accounting** and diffusion-side process-level tracking improvements. (#1204, #1276)

---

### Platform, Hardware Backends & Deployment

* **XPU / NPU / ROCm coverage improvements**

  * XPU Dockerfile + docs, enable FLASH_ATTN on XPU, fix XPU UT coverage; disable diffusion compile on XPU where needed. (#1162, #1332, #1164, #1148)
  * NPU upgrade to v0.16.0 and recovery fixes for Qwen3-TTS. (#1375, #1564)
  * ROCm CI/docker updates to track vLLM v0.16.0 stable. (#1380, #1500)
* **Deployment & connectivity**

  * Stage-based deployment CLI and UDS-based ZMQ address handling for stage serving. (#939, #1522)
  * **RDMA connector** support for high-performance interconnect scenarios. (#1019)
  * Platform-dependent package installation improvements. (#1046)

---

### CI, Testing, Docs & Developer Experience

* **CI quality + coverage**

  * Expanded test stratification design (L2/L3), nightly(L4) test runs, branch coverage fixes, and CI performance tuning. (#1272, #1333, #1120, #1283)
  * Improved CI stability (timeouts, reduced H100 usage, clearer logs). (#1460, #1543, #1463)
* **Docs & tutorials**

  * Tutorials on models/pipelines/features, diffusion tutorial refinements, Qwen3-TTS docs consistency, quantization Q&A updates, and installation instructions for vLLM 0.16.0. (#1196, #1305, #1226, #1257, #1505)
  * Improved examples (e.g., image-to-video download steps). (#1258)
* **Tooling**

  * Online profiling support and other developer ergonomics improvements. (#1136)

---

### Stability & Bug Fixes (Across the Stack)

This release includes broad correctness and robustness fixes spanning:

* **Diffusion pipelines** (dtype/shape, init crashes, model detection, seed and config handling)
* **Image edit / generation** endpoints (format validation, RoPE crash, argument typing, seed handling)
* **Distributed execution** (process group mapping accuracy, scheduler race conditions, kv transfer correctness)
* **General runtime hygiene** (removing unnecessary ZMQ init, CLI naming normalization, upstream-aligned error handling)

## What's Changed
* [TeaCache]: Add Coefficient Estimation by @princepride in https://github.com/vllm-project/vllm-omni/pull/940
* [CI]: Bagel E2E Smoked Test by @princepride in https://github.com/vllm-project/vllm-omni/pull/1074
* [Misc] Bump version to 0.14.0 by @ywang96 in https://github.com/vllm-project/vllm-omni/pull/1128
* [Doc] First stable release of vLLM-Omni by @ywang96 in https://github.com/vllm-project/vllm-omni/pull/1129
* [Misc] Align error handling with upstream vLLM v0.14.0 by @ceanna93 in https://github.com/vllm-project/vllm-omni/pull/1122
* [Feature] add Tensor Parallelism to LongCat-Image(-Edit) by @hadipash in https://github.com/vllm-project/vllm-omni/pull/926
* [CI] Temporarily remove slow tests. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1143
* [CI] Refactor test_sequence_parallel.py and add a warmup run for more accurate performance stat by @mxuax in https://github.com/vllm-project/vllm-omni/pull/1165
* Dev/rebase v0.15.0 by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1159
* Docs update paper link by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/1169
* [Debug] Clear Dockerfile.ci to accelerate build image by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1172
* [Debug] Correct Unreasonable Long Timeout by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1175
* [Doc]Fix - Align with repo. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1176
* [Bugfix][Qwen-Image-Edit] Add a warning log for none negative_prompt by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1170
* [Bugfix] fix qwen image oom by @ZJY0516 in https://github.com/vllm-project/vllm-omni/pull/1168
* [Hardware] Disable compile of diffusion on XPU by @zhenwei-intel in https://github.com/vllm-project/vllm-omni/pull/1148
* [Doc] Fix vLLM version in user docs by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/1179
* [Refactor] Refactor async chunk and fix the shape mismatch issue by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/1151
* bugfix: /images/edits endpoint fails pipeline data format check by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/1141
* [Perf] resolving prolonged `cudastreamsynchronize` execution in z image processing by @erfgss in https://github.com/vllm-project/vllm-omni/pull/1105
* [Bugfix] modify RTF use audio_e2e/audio_duration by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1157
* [Doc] Highlight paper & slides. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1186
* [chore] Remove zmq context initialize by @xiedeyantu in https://github.com/vllm-project/vllm-omni/pull/1187
* [NPU] Update Dockerfile and docs for v0.14.0 by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/671
* [Bugfix] E2E metric incorrect qwen3-omni with async chunk feature by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/1018
* [Doc] opt doc by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1118
* [Bugfix] Fix tp+sp accuracy, incorrect process group mapping by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1178
* [Feature] Enable use_audio_in_video for Qwen 3 Omni Online by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1198
* [Bugfix] async_chunk rebase v0.15.0 by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/1195
* [feature]: support flux cache_dit by @nuclearwu in https://github.com/vllm-project/vllm-omni/pull/1145
* [CI] Add CI branch coverage calculation,  fix statement coverage results and add log before test for buildkite  log group by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1120
* [Wan 2.2][Diffusion] Add TP Support by @Pr0Wh1teGivee in https://github.com/vllm-project/vllm-omni/pull/964
* [Hardware] [Feat] Setup platform dependent package installation by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/1046
* [XPU] Fix XPU UTs for basic coverage by @yma11 in https://github.com/vllm-project/vllm-omni/pull/1164
* [Test] Add BuildKite test-full script for full CI. by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/867
* [Refactor] Reuse upstream Qwen3MoeSparseMoeBlock by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1202
* [Bugfix] Fix wan2.2 ti2v by @mxuax in https://github.com/vllm-project/vllm-omni/pull/1221
* [Bugfix] Fix '--max-generated-image-size' cli args type by @ApsarasX in https://github.com/vllm-project/vllm-omni/pull/1249
* [Bugfix] Ensure seed=0 is correctly handled in image edit by @ApsarasX in https://github.com/vllm-project/vllm-omni/pull/1248
* [Docs] Add example image download step to Image-To-Video examples by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1258
* [Bugfix] Fix padding bug in 12Hz tokenizer ConvTranspose1d decode by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1241
* [bugfix] Fix multimodal_output property to check completion outputs where audio data is attached by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1203
* [Doc] Update QA relevant to quantization  by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1257
* [Bugfix] Fix Doc link Rrror by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1263
* Process-Scoped GPU Memory Accounting by @divyanshsinghvi in https://github.com/vllm-project/vllm-omni/pull/1204
* [ComfyUI]: ComfyUI integration by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/1113
* fix: add diffusion offload args to OmniConfig group instead of serve_parser by @fake0fan in https://github.com/vllm-project/vllm-omni/pull/1271
* [Doc] Adding models/pipelines/features Tutorial by @wtomin in https://github.com/vllm-project/vllm-omni/pull/1196
* [CI] Add env variable check for nightly CI  by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1281
* [CI] Add pytest markers to current tests and update the doc. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/577
* [Diffusion][Perf] Remove Redundant Communication Cost by Refining SP Hook Design by @mxuax in https://github.com/vllm-project/vllm-omni/pull/1275
* [Feature] Opt metrics structure by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/891
* [Test] Add example test cases for omni online by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1086
* [CI] Reduce the time for Diffusion Sequence Parallelism Test by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1283
* [Model] SupportHunyuanImage3 Diffusion Model in vllm-omni by @ElleElleWu in https://github.com/vllm-project/vllm-omni/pull/1085
* [Chore] Update copyright year. by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1256
* [feature]: support Flux.1-dev CFG-Parallel by @nuclearwu in https://github.com/vllm-project/vllm-omni/pull/1269
* [Bugfix] Fix 'NoneType' AttributeError in stable-diffusion model detect by @yma11 in https://github.com/vllm-project/vllm-omni/pull/1254
* [Doc] Update Qwen3-TTS docs for consistency with Omni examples by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1226
* [Fix]Ensure HuggingFace downloads complete before initialization. by @zzhuoxin1508 in https://github.com/vllm-project/vllm-omni/pull/1213
* [BugFix] Fixed the issue where ignore_eos was not working. by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/1286
* [Test] Add e2e tests for Qwen3-TTS speech endpoint by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1206
* [Feat]: support VAE patch parallelism by @dongbo910220 in https://github.com/vllm-project/vllm-omni/pull/756
* [CI] Disable Qwen3-TTS E2E Test in pipeline.yml by @Gaohan123 in https://github.com/vllm-project/vllm-omni/pull/1306
* [Misc] Add per-request generator_device to online image gen and edit by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1183
* [Bagel]: Support TP by @princepride in https://github.com/vllm-project/vllm-omni/pull/1293
* [Bugfix] Fix image edit RoPE crash when explicit height/width are provided by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1265
* [Doc] Sync by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1216
* [Bugfix] fix precision issues of qwen3-omni when enable async_chunk without system prompt by @R2-Y in https://github.com/vllm-project/vllm-omni/pull/1288
* [Debug] Add trigger to concurrent stage init by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1274
* [Bugfix][Qwen3-TTS] Fix task type by @ekagra-ranjan in https://github.com/vllm-project/vllm-omni/pull/1317
* Unifying CLI Argument Naming Style by @wtomin in https://github.com/vllm-project/vllm-omni/pull/1309
* [Bugfix][Qwen3-TTS] Preserve original model ID in omni_snapshot_download by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1318
* [CI] Run nightly tests. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1333
* [Feature]: FP8 Quantization Support for DiT  by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1034
* Fix yield token metrics and opt metrics record stats by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/1292
* [Test] L2 & L3 Test Case Stratification Design for Omni Model by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1272
* [Pref] Support Qwen3 Omni code2wav batch infernce with async chunk by @ZeldaHuang in https://github.com/vllm-project/vllm-omni/pull/1246
* update qwen3-omni & qwen2.5-omni openai client by @R2-Y in https://github.com/vllm-project/vllm-omni/pull/1304
* [Feature] Support Wan2.2 T2V and I2V Online Serving with OpenAI /v1/videos API by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/1073
* [Feature] add Tensor Parallelism to SD_3.5 by @GG-li in https://github.com/vllm-project/vllm-omni/pull/1336
* [Feature]async scheduling to overlap chunk IO and compute by @Shirley125 in https://github.com/vllm-project/vllm-omni/pull/951
* [Bugfix] reused metrics to modify the API Server token statistics in Stream Response by @kechengliu97 in https://github.com/vllm-project/vllm-omni/pull/1301
* Refactor CPU Offloading Backend Pattern by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/1223
* [DOC] Doc for CI test - Details about five level stucture and some other files. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1167
* [Bugfix] remove Tongyi-MAI/Z-Image-Turbo related test from L2 ci by @Bounty-hunter in https://github.com/vllm-project/vllm-omni/pull/1348
* [Misc] wechat image update by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1354
* [Misc] Support WorkerWrapperBase and CustomPipeline for Diffusion Worker by @knlnguyen1802 in https://github.com/vllm-project/vllm-omni/pull/764
* [Feature][Bugfix] Add CFG feature to Bagel by @nussejzz in https://github.com/vllm-project/vllm-omni/pull/1310
* [Feature]: Diffusion sleep to use process level memory calculation by @divyanshsinghvi in https://github.com/vllm-project/vllm-omni/pull/1276
* change qwen3-omni open cudagraph by default by @R2-Y in https://github.com/vllm-project/vllm-omni/pull/1352
* [XPU] Update Bagel's flash_attn_varlen_func to fa utils by @zhenwei-intel in https://github.com/vllm-project/vllm-omni/pull/1295
* [Test] Add Omni Model Performance Benchmark Test by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1321
* [BugFix]: Revert utils change by @princepride in https://github.com/vllm-project/vllm-omni/pull/1369
* [Rebase] Rebase to vllm v0.16.0 by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1357
* [Test] Fix expansion and example test case for qwen3-omni by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1358
* [v0.16.0][BUG FIX]Fix hunyuan MOE after update to 0.16.0 by @xuechendi in https://github.com/vllm-project/vllm-omni/pull/1401
* [0.16.0] remove cuda hard-code for Hunyuan Image3 by @xuechendi in https://github.com/vllm-project/vllm-omni/pull/1402
* [XPU] Add XPU Dockerfile and related docs by @yma11 in https://github.com/vllm-project/vllm-omni/pull/1162
* [Bugfix] Fix Hardcoded Datatypes in Z-image by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/1393
* [Feature] : Support disaggregated inference pipeline for Qwen3_TTS by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/1161
* [Feature] Add automated PR reviewer bot with GLM integration by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/1424
* [Misc] Add Qwen2.5-Omni-3B model support to Gradio demo by @UsamaKenway in https://github.com/vllm-project/vllm-omni/pull/1382
* [misc] Feature/pr reviewer auto trigger&update model by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/1431
* Revert "[misc] Feature/pr reviewer auto trigger&update model" by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/1432
* [Doc] Update GPU installation commands by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1434
* [ROCM] [CI] fix dockerfile.rocm to support nightly build and also fix amd ci v0.16.0rc1 by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/1380
* [Feature][BAGEL] Combine multi-branch cfg into a single batch to accelerate inference. by @nussejzz in https://github.com/vllm-project/vllm-omni/pull/1429
* [Feat]: add ASCII art logo for vLLM-Omni  by @zzhuoxin1508 in https://github.com/vllm-project/vllm-omni/pull/1430
* [Bug] [Bagel] Fix kv transfer bug by @nussejzz in https://github.com/vllm-project/vllm-omni/pull/1437
* [CI] Set L2 & L3 tests running conditions. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1344
* [Feature] vLLM-Omni RDMA connector by @natureofnature in https://github.com/vllm-project/vllm-omni/pull/1019
* [Minor][Refactor] Pass seq_token_counts explicitly by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1425
* [Misc] Extend Diffusion Benchmark script to other backends by @NickLucche in https://github.com/vllm-project/vllm-omni/pull/875
* [Feature] Support Stage Based Deployment CLI by @wuhang2014 in https://github.com/vllm-project/vllm-omni/pull/939
* [Doc] Optimize vLLM-Omni metrics documentation by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/1311
* [Bugfix]  Forward all vllm-omni serve command parameters to model by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/985
* [Doc]: Add bagel single/multi node usage with mooncake document by @princepride in https://github.com/vllm-project/vllm-omni/pull/1450
* [Qwen3TTS][Feat] Code2Wav batched decoding by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/1426
* [CI] Remove overwhelming debug log by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1463
* [Misc] update wechat image by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1464
* [Doc] Refine Diffusion Tutorial Documents by @wtomin in https://github.com/vllm-project/vllm-omni/pull/1305
* [Bugfix] Robust Audio Data Handling in _create_audio_choice by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/1222
* [Bugfix]: Fix merging updated additional information to ensure dict type by @Dovis01 in https://github.com/vllm-project/vllm-omni/pull/1296
* [Model]Add new nextstep_1(Diffusion) model(only T2I) by @sniper35 in https://github.com/vllm-project/vllm-omni/pull/612
* [Bugfix] Add TTS configuration options by @YanickSchraner in https://github.com/vllm-project/vllm-omni/pull/1177
* [Debug] Multi-Request for Qwen 3 Omni use_audio_in_video by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1433
* [Bugfix] Fix case-sensitive task_type matching in Qwen3TTSModelForGeneration by @upskyy in https://github.com/vllm-project/vllm-omni/pull/1455
* [BugFix] process request.num_cached_tokens if it equals to the initial value  by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/1468
* [Bugfix] Fix SDPA attention mask dtype and shape (Fix #857) by @yJader in https://github.com/vllm-project/vllm-omni/pull/1349
* [Test] Reduce Perf test case and fix modify stage config by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1449
* [NPU] Upgrade to v0.16.0 by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1375
* [CI] Update Dockerfile for vllm-omni CI image and remove obsolete dep… by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1491
* [Fix][Chore] Qwen3-TTS Modeling Minor Code Sanity Improvements by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/1482
* [Bugfix] Fix tuple/list KV cache extraction crash by @junuxyz in https://github.com/vllm-project/vllm-omni/pull/1405
* [Doc] format lora related docs for the user's end by @AndyZhou952 in https://github.com/vllm-project/vllm-omni/pull/1009
* [Feature] Support Wan2.2 output with irregular shapes by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1279
* [Misc] Migrate L1 tests to use pytest-mock by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/1315
* [Bugfix] Fix LoRA Scaling on Active Adapters by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/1421
* [Bugfix] fix record audio generated frame in offline infer by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/1312
* [Model] Support OmniGen2 by @legitnull in https://github.com/vllm-project/vllm-omni/pull/513
* [Bugfix][Qwen3TTS] by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/1289
* Use pull through cache image for H100 pool by @khluu in https://github.com/vllm-project/vllm-omni/pull/1518
* [ROCm] [CI] [Docker] Point to use the latest vLLM v0.16.0 stable version by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/1500
* [Bugfix] fix offline text_to_image error from #1009 by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1515
* [XPU] Enable FLASH_ATTN on XPU by @yma11 in https://github.com/vllm-project/vllm-omni/pull/1332
* Revert gpu_1 job to use regular image by @khluu in https://github.com/vllm-project/vllm-omni/pull/1521
* [Chore] remove unused logger in omni_diffusion (#531) by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/1509
* [Qwen3TTS][Feat] Streaming output by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/1438
* [Bugfix] Race condition in MultiprocExecutor when concurent access to Scheduler by @knlnguyen1802 in https://github.com/vllm-project/vllm-omni/pull/1448
* [Doc][Test][Misc] ComfyUI test, more screenshot, and code cleaning by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/1435
* [Performance]Qwen3-Omni performance optimization by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/1378
* [Feature] Support HSDP for diffusion models by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1339
* [CI] fixed CI timeout by @zhumingjue138 in https://github.com/vllm-project/vllm-omni/pull/1460
* [Bugfix] Use uds for zmq address if not set --stage-id by @wuhang2014 in https://github.com/vllm-project/vllm-omni/pull/1522
* [BugFix] Restore talker's config by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/1524
* [XPU] fix qwen_omni after rebase to v0.16.0 by @xuechendi in https://github.com/vllm-project/vllm-omni/pull/1416
* [Platform] Enable layerwise offload on all hardware by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1492
* diffusion: enable VAE patch parallel for SD3.5 by @dongbo910220 in https://github.com/vllm-project/vllm-omni/pull/1428
* [Perf] GLM Image by @JaredforReal in https://github.com/vllm-project/vllm-omni/pull/920
* [skip ci][Doc] add design docs for async chunk in qwen3-omni by @R2-Y in https://github.com/vllm-project/vllm-omni/pull/962
* feat(qwen3-tts): Add CUDA Graph support for speech tokenizer decoder by @xulusjb in https://github.com/vllm-project/vllm-omni/pull/1205
* [New Model]: XiaomiMiMo/MiMo-Audio-7B-Instruct support by @qibaoyuan in https://github.com/vllm-project/vllm-omni/pull/750
* [Feature]: Native GGUF Quantization Support for DiT by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1285
* Add benchmark for `v1/audio/speech` non-streaming by @ekagra-ranjan in https://github.com/vllm-project/vllm-omni/pull/1408
* [Version] Auto generate version using `setuptool_scm` by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/1224
* [Feat] : Support Async chunk cleanup by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/1087
* [Profiler] Support online profiling by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1136
* [Bugfix] Fix redundant finished req status updating on OmniGenerationScheduler by @Dovis01 in https://github.com/vllm-project/vllm-omni/pull/1510
* [XPU][NPU][ROCM] enable cpu_offloading flag for non_cuda by @xuechendi in https://github.com/vllm-project/vllm-omni/pull/1488
* [Chore] Cleanup dead code in GGUF DiT code path by @Isotr0py in https://github.com/vllm-project/vllm-omni/pull/1533
* [Doc] Update installation instructions for vllm 0.16.0 by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1505
* [Doc] [skip ci]Sync. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1363
* [CI][skip ci]Update H100 image link based on #1518 by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1538
* Fix no embed text spk tokens by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/1540
* [Debug] Merge vllm pull 35368 by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1534
* [Docs] update async chunk docs diagram [skip ci] by @R2-Y in https://github.com/vllm-project/vllm-omni/pull/1530
* fix(qwen3-tts): fix Base ICL voice clone producing corrupted audio by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1554
* [NPU][Bugfix] Align GPU side and recover qwen3-tts by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1564
* [BugFix] Fix unexpected crash when init OmniDiffusion by @Semmer2 in https://github.com/vllm-project/vllm-omni/pull/1562
* [CI] Modify some CI test cases to run on L4 environment to reduce H100 resource usage. by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1543
* [BugFix]: fix a lot of bug by @princepride in https://github.com/vllm-project/vllm-omni/pull/1565

## New Contributors
* @ceanna93 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1122
* @hadipash made their first contribution in https://github.com/vllm-project/vllm-omni/pull/926
* @zhenwei-intel made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1148
* @erfgss made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1105
* @xiedeyantu made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1187
* @Pr0Wh1teGivee made their first contribution in https://github.com/vllm-project/vllm-omni/pull/964
* @yma11 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1164
* @ElleElleWu made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1085
* @ekagra-ranjan made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1317
* @Shirley125 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/951
* @xuechendi made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1401
* @alex-jw-brooks made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1393
* @Sy0307 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1161
* @UsamaKenway made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1382
* @Dovis01 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1296
* @YanickSchraner made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1177
* @upskyy made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1455
* @yJader made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1349
* @junuxyz made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1405
* @legitnull made their first contribution in https://github.com/vllm-project/vllm-omni/pull/513
* @khluu made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1518
* @zhumingjue138 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1460
* @xulusjb made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1205
* @Semmer2 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1562

**Full Changelog**: https://github.com/vllm-project/vllm-omni/compare/v0.14.0...v0.16.0