v0.18.0

vllm-project/vllm-omniv0.18.0Mar 28, 2026by david6666666

AI Summary

v0.18.0 is a major rebase and systems release aligning with upstream vLLM v0.18.0. It features a refactored serving entrypoint architecture, strengthened audio/speech production serving, substantial diffusion optimization, expanded multimodal model coverage, and a unified quantization framework.

Key Highlights

  • Rebased to upstream vLLM v0.18.0.
  • Refactored the serving entrypoint architecture.
  • Strengthened audio, speech, and omni production serving for Qwen3-TTS, Qwen3-Omni, and Fish Speech.
  • Delivered substantial diffusion optimization with scheduler/executor refactoring, cache-dit, and TP/SP/HSDP support.
  • Expanded model support including Helios, FLUX.2-dev, FLUX.1-Kontext-dev, and Fish Speech S2 Pro.
  • Introduced a unified quantization framework.

New Features

  • Added MammothModa2 support.
  • Added Fun CosyVoice3-0.5B-2512 support.
  • Added Fish Speech S2 Pro support.
  • Added Voxtral TTS support.
  • Added Hunyuan Image-3.0 AR support.
  • Added FLUX.2-dev support.
  • Added FLUX.1-Kontext-dev support.

Full Release Notes

## Highlights

This release features 324 commits from 83 contributors, including 38 new contributors.

vLLM-Omni v0.18.0 is a major rebase and systems release that aligns the project with upstream vLLM v0.18.0, strengthens the core runtime through a large entrypoint refactor and scheduler/runtime cleanups, expands unified quantization and diffusion execution, broadens multimodal model coverage, and improves production readiness across audio, omni, image, video, RL, and multi-platform deployments. 

### Key Improvements

* **Rebased to upstream vLLM v0.18.0**, with follow-up updates to docs and dockerfiles, plus cleanup of patches that were no longer needed after the rebase. **(#2037, #2038, #2062, #2271)** 
* **Refactored the serving entrypoint architecture**, making the stack cleaner and easier to extend, while also laying groundwork for PD disaggregation, multimodal output decoupling, coordinator-based orchestration, and pipeline config cleanup. **(#1908, #1863, #1816, #1465, #1115)** 
* **Strengthened audio, speech, and omni production serving**, especially for Qwen3-TTS, Qwen3-Omni, MiMo-Audio, Fish Speech S2 Pro, and Voxtral TTS, with lower latency, better concurrency, more robust streaming, and improved online serving stability. **(#1583, #1617, #1797, #1913, #1985, #1852, #1656, #1963, #2009, #2019, #2239, #1688, #1752, #1964, #2225, #1859, #2145, #2151, #2156, #2158)** 
* **Delivered substantial diffusion optimization**, with scheduler/executor refactoring, faster startup, better cache-dit / TeaCache integration, broader TP/SP/HSDP support, and multiple correctness fixes for online and offline serving. **(#1625, #1504, #1715, #1834, #1848, #1234, #2163, #1979, #2101, #2176)** 
* **Expanded model support across omni, speech, image, and video**, including Helios, Helios-Mid / Distilled, MammothModa2, Fun CosyVoice3-0.5B-2512, FLUX.2-dev, FLUX.1-Kontext-dev, Hunyuan Image3 AR, Fish Speech S2 Pro, Voxtral TTS, DreamID-Omni, LTX-2, and HunyuanVideo-1.5. **(#1604, #1648, #336, #498, #1629, #561, #759, #1798, #1803, #1855, #841, #1516)** 
* **Introduced a unified quantization framework** and expanded quantization support across diffusion and image workloads, including INT8, FP8, and GGUF-related enablement. **(#1764, #1470, #1640, #1755, #1473, #2180)** 
* **Improved RL and custom pipeline readiness, verl collaboration & Qwen-Image E2E RL**, Expanded RL-oriented serving in close collaboration with verl, helping enable Qwen-Image end-to-end RL / Flow-GRPO training with collective RPC support. Including collective RPC support at the entrypoint, custom input/output support, async batching for Qwen-Image, and dedicated E2E coverage for custom RL pipelines. **(#1646, #1593, #2005, #2217)** 

### Core Architecture & Runtime

* Reworked the core serving architecture through the **vLLM-Omni Entrypoint Refactoring**, while also adding PD disaggregation scaffolding, coordinator support, multimodal output decoupling foundations, and cleaner model/pipeline configuration handling. **(#1908, #1863, #1465, #1816, #1115, #1958, #2105)** 
* Continued cleanup of runtime internals with stage/step pipeline refactors, dead-code cleanup, and improvements to async engine robustness and scheduler state handling. **(#1368, #1579, #2153, #2028, #1893)** 

### Model Support

* **Omni / speech / audio models:** added or expanded support for **MammothModa2**, **Fun CosyVoice3-0.5B-2512**, **Fish Speech S2 Pro**, and **Voxtral TTS**. **(#336, #498, #1798, #1803)** 
* **Image / diffusion models:** added or expanded support for **Hunyuan Image-3.0**, **FLUX.2-dev**, **FLUX.1-Kontext-dev**, and continued improvements for **Qwen-Image**, **Qwen-Image-Edit**, **Qwen-Image-Layered**, **LongCat-Image**, **GLM-Image**, **Bagel**, and **OmniGen2**. **(#759, #1629, #561, #1682, #2085, #1970, #2035, #1918, #1578, #1669, #1903, #1711, #1934)** 
* **Video models:** added or expanded support for **Helios**, **Helios-Mid / Distilled**, **DreamID-Omni**, **LTX-2**, **HunyuanVideo-1.5**, and updated supported video-generation coverage for **Wan2.1-T2V**. **(#1604, #1648, #1855, #841, #1516, #1920)** 

### Audio, Speech & Omni Production Optimization

* **Qwen3-TTS** received major optimization work, including lower TTFA, better high-concurrency throughput, improved Code Predictor / Code2Wav execution, websocket streaming audio output, async scheduling by default, voice upload support, optional `ref_text`, and long `ref_audio` handling fixes. **(#1583, #1617, #1797, #1913, #1985, #1852, #1719, #1853, #1201, #1879, #2046, #2104)** 
* **Qwen3-Omni** gained lower inter-packet latency, speaker-switching support, decode-alignment fixes, and multiple correctness fixes for answer quality and online serving stability. **(#1656, #1963, #2009, #2019, #2239)** 
* **MiMo-Audio** improved compatibility and production robustness with TP fixes, broader attention backend support, configurable chunk sizing, and documentation to prevent noise-only outputs under unsupported attention setups. **(#1688, #1752, #1964, #2225, #2205)** 
* **Fish Speech S2 Pro** and **Voxtral TTS** were productionized further with online serving, voice cloning, better TTFP / inference performance, multilingual demo support, lighter flow matching, and voice-embedding fixes. **(#1798, #1859, #2145, #1803, #2045, #2056, #2067, #2151, #2156, #2158, #2023)** 
* Added or improved speech-serving interfaces, including **speech batch entrypoint**, **speaker embedding support for speech and voices APIs**, proper HTTP status handling, and streaming `wav` response support. **(#1701, #1227, #1687, #1819)** 

### Diffusion, Image & Video Generation

* **Runtime refactor & benchmarking:** Refactored the diffusion runtime with cleaner scheduler/executor boundaries, better request-state flow, unified profiling, and stronger benchmarking infrastructure. **(#1625, #2099, #1757, #1917, #1995)**
* **Performance & startup gains:** Improved diffusion performance through multi-threaded weight loading for Wan2.2, reduced IPC overhead for single-stage serving, cache-dit upgrades, TeaCache support, and nightly performance improvements for Qwen-Image. **(#1504, #1715, #1834, #1234, #1314, #1805, #2111)**
* **Distributed scaling:** Expanded distributed diffusion execution with broader TP/SP/HSDP support across Flux, GLM-Image, Hunyuan, and Bagel. **(#1250, #1900, #1918, #2163, #1903)**
* **Serving UX & API ergonomics:** Improved serving usability with a progress bar for diffusion models, richer image-edit parameters such as layers and resolution, and extra request-body support for video APIs. **(#1652, #2053, #1955)**
* **Correctness & stability fixes:** Fixed a wide range of diffusion correctness issues, including config misalignment between offline and online inference, TP/no-seed broken-image issues, GLM-Image stage/device bugs, and TeaCache incompatibilities. **(#1979, #2176, #2137, #2101, #1894, #2025)**


### Quantization & Memory Efficiency

* Added the **Unified Quantization Framework** as a core infrastructure upgrade for more consistent quantized execution across model families. **(#1764)** 
* Expanded quantization support for diffusion/image workloads, including **INT8 for DiT (Z-Image and Qwen-Image)**, **FP8 for Flux transformers**, and **GGUF adapter support for Qwen-Image**. **(#1470, #1640, #1755)** 
* Improved compatibility between quantization and runtime features such as **CPU offload**, **tensor parallelism**, and **Flux-family execution**. **(#1473, #1723, #1978, #2180)** 

### RL, Serving & Integrations

* **verl collaboration & Qwen-Image E2E RL:** Expanded RL-oriented serving in close collaboration with verl, helping enable Qwen-Image end-to-end RL / Flow-GRPO training with collective RPC support, custom input/output, async batching for Qwen-Image, and dedicated E2E CI coverage for custom RL pipelines. **(#1646, #1593, #2005, #2217)**
* **Rollout scaling for visual RL:** Added rollout building blocks referenced by verl’s Qwen-Image integration plan, including async batching for Qwen-Image plus tensor-parallel and data-parallel support for diffusion serving. **(#1593, #1713, #1706)**
* **Deployment & ecosystem integrations:** Improved deployment and ecosystem integration with a Helm chart for Kubernetes, ComfyUI video & LoRA support, and a rewritten async video API lifecycle. **(#1337, #1596, #1665)**

### Platforms, Distributed Execution & Hardware Coverage

* Continued improving portability across **CUDA, ROCm, NPU, and XPU/Intel GPU** environments, including rebase follow-ups, ROCm CI setup, Intel CI dispatch, Intel GPU docs, and NPU docker/docs refreshes. **(#2017, #1984, #1721, #2154, #2271, #2091)** 
* Expanded distributed execution coverage with **T5 tensor parallelism**, more model-level TP/SP/HSDP support, and better handling of visible GPUs and stage-device initialization. **(#1881, #1250, #1900, #1918, #2163, #2025)** 

### CI, Benchmarks & Documentation

* Strengthened release engineering and CI with a **release pipeline**, richer nightly benchmark/report generation, L3/L4/L5 test layering, expanded model E2E coverage, and stronger diffusion test coverage. **(#1726, #1831, #1995, #1514, #1799, #2086, #1869, #2085, #2087, #2132, #2129, #2023)** 
* Improved benchmarking with **Qwen3-TTS benchmark scripts**, nightly Qwen3-TTS and Qwen-Image performance tracking, diffusion timing, random benchmark datasets, and T2I/I2I accuracy benchmark integration. **(#1573, #1700, #1805, #2111, #1757, #1657, #1917)** 
* Refreshed project docs across installation, omni/TTS docs, diffusion serving parameters, UAA documentation, developer guides, and governance. **(#1762, #1693, #2051, #2130, #2148, #1889)** 

### Note
  * GLM-Image requires manually upgrading the `transformers` version to >= 5.0.

## What's Changed
* 0.16.0 release by @ywang96 in https://github.com/vllm-project/vllm-omni/pull/1576
* [Refactor]: Phase1 for rebasing_additional_info by @divyanshsinghvi in https://github.com/vllm-project/vllm-omni/pull/1394
* [Feature]: Support cfg kv-cache transfer in multi-stage by @princepride in https://github.com/vllm-project/vllm-omni/pull/1422
* [BugFix] Fix load_weights error when loading HunyuanImage3.0 by @Semmer2 in https://github.com/vllm-project/vllm-omni/pull/1598
* [Bugfix] fix kernel error for qwen3-omni by @R2-Y in https://github.com/vllm-project/vllm-omni/pull/1602
* [bugfix] Fix unexpected argument 'is_finished' in function llm2code2wav_async_chunk of mimo-audio by @qibaoyuan in https://github.com/vllm-project/vllm-omni/pull/1570
* [Bugfix] Import InputPreprocessor into Renderer by @lengrongfu in https://github.com/vllm-project/vllm-omni/pull/1566
* [Feature][Wan2.2] Speed up diffusion model startup by multi-thread weight loading by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/1504
* [Bugfix][Model] Fix LongCat Image Config Handling / Layer Creation by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/1485
* [Bugfix] Fix Qwen3-TTS code predictor crash due to missing vLLM config context by @ZhanqiuHu in https://github.com/vllm-project/vllm-omni/pull/1619
* [Debug] Enable curl retry aligned with openai by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1539
* [Doc] Fix links in the configuration doc by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/1615
* [CI] Add scripts for bechmark collection and email distribution. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1307
* [FEATURE] Tile/Patch parallelism refactor for easily support other models by @Bounty-hunter in https://github.com/vllm-project/vllm-omni/pull/1366
* [Bugfix] Fix filepath resolution for model with subdir and GLM-Image generation by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/1609
* Make chunk_size and left_context_size configurable via YAML for async chunking by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/1423
* [Bugfix] Fix transformers 5.x compat issues in online TTS serving by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1536
* [Refactor] lora: reuse load_weights packed mapping by @dongbo910220 in https://github.com/vllm-project/vllm-omni/pull/991
* [Model]: Support Helios  from ByteDance by @princepride in https://github.com/vllm-project/vllm-omni/pull/1604
* [chore] add _repeated_blocks for regional compilation support by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1642
* [Bugfix] Add TTS request validation to prevent engine crashes by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1641
* [CI] Fix ASCII codes. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1647
* [Misc] update wechat by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1649
* docs: Announce vllm-omni-skills community project by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/1651
* [Model] Add Hunyuan Image3 AR Support by @usberkeley in https://github.com/vllm-project/vllm-omni/pull/759
* [Test][Qwen3-Omni]Modify Qwen3-Omni benchmark test cases by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/1628
* [Bugfix] Fix Dtype Parsing by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/1391
* [XPU] fix UMD version in docker file by @yma11 in https://github.com/vllm-project/vllm-omni/pull/1545
* add support for MammothModa2 model by @HonestDeng in https://github.com/vllm-project/vllm-omni/pull/336
* [Model] Fun cosy voice3-0.5-b-2512 by @divyanshsinghvi in https://github.com/vllm-project/vllm-omni/pull/498
* [Bugfix] Enable torch.compile for low noise model (transformer_2) by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1541
* [NPU] [Features] [Bugfix] Support mindiesd adaln by @jiangmengyu18 in https://github.com/vllm-project/vllm-omni/pull/1537
* [FP8 Quantization] Add FP8 quantization support for Flux transformer by @zzhuoxin1508 in https://github.com/vllm-project/vllm-omni/pull/1640
* Replace hard-coded cuda generator with current_omni_platform.device_type by @pi314ever in https://github.com/vllm-project/vllm-omni/pull/1677
* [BugFix] Fix LongCat Sequence Parallelism / Small Cleanup by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/1631
* [Misc] remove logits_processor_pattern this field, because vllm have … by @lengrongfu in https://github.com/vllm-project/vllm-omni/pull/1675
* [CI] Remove high concurrency tests before issue #1374 fixed. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1683
* [Optimize][Qwen3-Omni] Reduce inter-packet latency in async chunk  by @ZeldaHuang in https://github.com/vllm-project/vllm-omni/pull/1656
* [Feat][Qwen3TTS] reduce TTFA with flexible initial phase by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/1583
* [Model] support LTX-2 text-to-video image-to-video by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/841
* [BugFix] Return proper HTTP status for ErrorResponse in create_speech by @Lidang-Jiang in https://github.com/vllm-project/vllm-omni/pull/1687
* [Doc] Add the test guide document. [skip ci] by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1376
* [UX] Add progress bar for diffusion models by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1652
* [Bugfix] Fix all-silence TTS output: use float32 for speech tokenizer decoder by @ZhanqiuHu in https://github.com/vllm-project/vllm-omni/pull/1664
* [Feature] Support flexible task_type configuration for Qwen3-TTS models by @JackLeeHal in https://github.com/vllm-project/vllm-omni/pull/1197
* [Cleanup] Move cosyvoice3 tests to model subdirectory by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1666
* [Feature][Bagel] Add CFG parallel mode by @nussejzz in https://github.com/vllm-project/vllm-omni/pull/1578
* perf: replace per-element .item() GPU syncs with batch .tolist() in TTS code predictor by @dubin555 in https://github.com/vllm-project/vllm-omni/pull/1614
* [Refactor][Perf] Qwen3-TTS: re-prefill Code Predictor with torch.compile + enable Code2Wav decoder CUDA Graph by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/1617
* [MiMo-Audio] Bugfix tp lg than 1 by @qibaoyuan in https://github.com/vllm-project/vllm-omni/pull/1688
* Add non-async chunk support for Qwen3-TTS by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1678
* [1/N][Refactor] Clean up dead code in output processor by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1579
* [feature]: support flux2.klein cache_dit by @nuclearwu in https://github.com/vllm-project/vllm-omni/pull/1209
* [skip CI][Docs] Add TTS model developer guide by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1693
* [Profile] Adding metrics for Diffusion/DiT Single diffusion Pipeline by @erfgss in https://github.com/vllm-project/vllm-omni/pull/668
* [Feature]:  Add vae-patch-parallel CLI argument in online serving by @wtomin in https://github.com/vllm-project/vllm-omni/pull/1716
* Revert "[Profile] Adding metrics for Diffusion/DiT Single diffusion Pipeline (#668)" by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1724
* [CI] Add release-pipeline.yaml. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1726
* [NPU] Support Helios-Mid / Distilled by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1648
* [skip ci] Update slides link by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/1730
* [Bugfix] (qwen3_tts): enable batched offline inference by fixing tens… by @RomanKoshkin in https://github.com/vllm-project/vllm-omni/pull/1417
* [Bugfix] Use upstream MediaConnector for ref_audio resolution by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1661
* [RL] Support collective rpc api to entrypoint && Support custom input output  by @knlnguyen1802 in https://github.com/vllm-project/vllm-omni/pull/1646
* Pre-download Qwen3-TTS model in CI to avoid intermittent download timeouts by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1727
* [1/N] fix CP for Helios by @SHYuanBest in https://github.com/vllm-project/vllm-omni/pull/1729
* feat(tts): add voice upload API for Qwen3-TTS by @zhaotyer in https://github.com/vllm-project/vllm-omni/pull/1201
* [Bagel] Eliminate broadcast in CFG parallel denoising loop by @nussejzz in https://github.com/vllm-project/vllm-omni/pull/1695
* [Feat]: Offline inference supports async_chunk by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/1415
* [Bugfix] Allow to enable HSDP alone by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1567
* Disable mm processor cache in CI stage configs by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1739
* Dev/rebase v0170 by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1639
* [Perf] Reduce IPC overhead for single-stage diffusion serving for Wan2.2 by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/1715
* [Test] Solving the Issue of Whisper Model's GPU Memory Not Being Successfully Cleared and the Occasional Accuracy Problem of the Qwen3-omni Model Test by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1744
* [Bagel]: Support multistage img2img by @princepride in https://github.com/vllm-project/vllm-omni/pull/1669
* [BugFix] Enable CPU offloading and Cache-DiT together on Diffusion Model by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/1723
* [Doc] CLI Args Naming Style Correction by @wtomin in https://github.com/vllm-project/vllm-omni/pull/1750
* [Feature] Add Helm Chart to deploy vLLM-Omni on Kubernetes by @oglok in https://github.com/vllm-project/vllm-omni/pull/1337
* [Fix][Qwen3-TTS] Preserve ref_code decoder context for Base ICL by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/1731
* Add online serving to Stable Audio Diffusion and introduce `v1/audio/generate` endpoint by @ekagra-ranjan in https://github.com/vllm-project/vllm-omni/pull/1255
* [Enhancement][pytest] Check for process running during start server by @pi314ever in https://github.com/vllm-project/vllm-omni/pull/1559
* [CI]: Add core_model and cpu markers for L1 use case. by @zhumingjue138 in https://github.com/vllm-project/vllm-omni/pull/1709
* [Doc][skip-ci] Update installation instructions by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1762
* Revert "Add online serving to Stable Audio Diffusion and introduce `v1/audio/generate` endpoint" by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/1789
* [BUGFIX] Add compatibility for mimo-audio with vLLM 0.17.0 by @qibaoyuan in https://github.com/vllm-project/vllm-omni/pull/1752
* [feat][Qwen3TTS] Simple dynamic TTFA based on Code2Wav load by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/1714
* [Refactor][Perf] Qwen3-omni: code predictor with re-prefill + SDPA and eliminate decode hot-path CPU round-trips by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/1758
* [Feat][Qwen3-tts]: Add Gradio demo for online serving by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1231
* [Docs] update async chunk performance diagram by @R2-Y in https://github.com/vllm-project/vllm-omni/pull/1741
* [Feat] Enable expert parallel for diffusion MoE layers by @Semmer2 in https://github.com/vllm-project/vllm-omni/pull/1323
* [Bugfix]: SP attention not enabling when _sp_plan hooks are not applied by @wtomin in https://github.com/vllm-project/vllm-omni/pull/1704
* [skip ci] [Docs] Update WeChat QR code for community support by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1802
* update GpuMemoryMonitor to DeviceMemoryMonitor for all HW by @xuechendi in https://github.com/vllm-project/vllm-omni/pull/1526
* Add coordinator module and corresponding unit test by @NumberWan in https://github.com/vllm-project/vllm-omni/pull/1465
* [Model]: add FLUX.2-dev model by @nuclearwu in https://github.com/vllm-project/vllm-omni/pull/1629
* [skip ci][Docs] doc fix for example snippets by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/1811
* [Test] L4 complete diffusion feature test for Qwen-Image-Edit models by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/1682
* [Frontend] ComfyUI video & LoRA support by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/1596
* [Bugfix] Adjust Z-Image Tensor Parallelism Diff Threshold by @wtomin in https://github.com/vllm-project/vllm-omni/pull/1808
* [Bugfix] Expose base_model_paths property in _DiffusionServingModels by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1771
* [Bugfix] Report supported tasks for omni models to skip unnecessary chat init by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1645
* [Test] Add Qwen3-TTS nightly performance benchmark by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1700
* Add Qwen3-TTS benchmark scripts by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1573
* [Test] Skip the qwen3-omni relevant validation for a known issue 1367. by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1812
* Fix duplicate get_supported_tasks definition in async_omni.py by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1825
* [Enhancement] Patch OmniStage.try_collect() with _proc alive checks by @pi314ever in https://github.com/vllm-project/vllm-omni/pull/1560
* [Doc][skip ci] Update readme with Video link for vLLM HK First Meetup by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1833
* [Feat][Qwen3-TTS] Support streaming audio output for websocket  by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/1719
* [Test] Nightly Buildkite Pytest Test Case Statistics And Send HTML Report By Email by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1674
* [Enhancement] Patch OmniStage.try_collect() with ray alive checks by @pi314ever in https://github.com/vllm-project/vllm-omni/pull/1561
* [Feat][Diffusion]: Implement Component-Level VRAM Quota and Resource Domain Isolation by @Flink-ddd in https://github.com/vllm-project/vllm-omni/pull/1582
* [Feature]: Enable directly use OmniLLM init AR model by @princepride in https://github.com/vllm-project/vllm-omni/pull/1821
* [Enhancement] Upgrade cache-dit from 1.2.0 to 1.3.0 by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/1834
* [Bugfix] Modify _resolve_pytest_target to support glob patterns and return multiple paths by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1843
* [Feat] add wav response_format when stream is true in /v1/audio/speec… by @lengrongfu in https://github.com/vllm-project/vllm-omni/pull/1819
* [BugFix]: Revert #1582 by @princepride in https://github.com/vllm-project/vllm-omni/pull/1842
* [Feature]: support Flux.2-dev cache_dit by @nuclearwu in https://github.com/vllm-project/vllm-omni/pull/1814
* [skip ci] update readme slides link by @hsliuustc0106 in https://github.com/vllm-project/vllm-omni/pull/1850
* [Model] Extend NPU support for HunyuanImage3 Diffusion Model by @ElleElleWu in https://github.com/vllm-project/vllm-omni/pull/1689
* [Config Refactor][1/2] Model Pipeline Configuration System by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1115
* [Test] Reduce SP & Offloading test cases for L2 by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/1839
* [bugfix] Add Interleaved 2D Rotary Embedding for HunyuanImage3 by @usberkeley in https://github.com/vllm-project/vllm-omni/pull/1784
* [Bugfix] Fix Helios text_encoder embed_tokens all-zeros due to untied weights by @dubin555 in https://github.com/vllm-project/vllm-omni/pull/1728
* Enable async_scheduling by default for Qwen3-TTS by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1853
* [CI failure] Comment out test_zimage_vae_patch_parallel_tp2 by @Gaohan123 in https://github.com/vllm-project/vllm-omni/pull/1856
* Add Fish Speech S2 Pro support with online serving and voice cloning by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1798
* [skip CI][Docs] add connector design document by @natureofnature in https://github.com/vllm-project/vllm-omni/pull/1737
* [BugFix] Readme and example runner file for cosyvoice3 missed in refactoring by @divyanshsinghvi in https://github.com/vllm-project/vllm-omni/pull/1685
* [Refactor] Use SP Plan for LongCat Sequence Parallelism by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/1772
* [CI failed] Disable test for zimage tensor parallelism by @Gaohan123 in https://github.com/vllm-project/vllm-omni/pull/1870
* [Bugfix] Fix SD3.5-medium attn2 uninitialized weights by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1659
* [Bugfix] fix layer-wise offload incompatible with cache-dit by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1786
* [CI failed] Disable Diffusion Tensor Parallelism Test by @Gaohan123 in https://github.com/vllm-project/vllm-omni/pull/1876
* [BugFix]: Fix bagel online inference bug by @princepride in https://github.com/vllm-project/vllm-omni/pull/1804
* [Frontend] Rewrite video API for async job lifecycle by @ieaves in https://github.com/vllm-project/vllm-omni/pull/1665
* [Diffusion] [Model] Dreamid-Omni from bytedance by @Bounty-hunter in https://github.com/vllm-project/vllm-omni/pull/1855
* [Bugfix] Restore voice upload API and profiler endpoints reverted by #1719 by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1879
* [BugFix] Fix Max Rank Handling in LoRA by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/1397
* Buildkite hardware ci xpu test by @pi314ever in https://github.com/vllm-project/vllm-omni/pull/1340
* [CI] add multimodal processing correctness tests for Omni models by @zzhuoxin1508 in https://github.com/vllm-project/vllm-omni/pull/1445
* fix: propagate parallel_config through create_default_diffusion by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1878
* [CI pipeline] Re-enable Diffusion Tensor Parallelism Test in pipeline by @Gaohan123 in https://github.com/vllm-project/vllm-omni/pull/1892
* [skip CI][Docs][Benchmark]: clarify vbench parameter behavior and add t2v example by @asukaqaq-s in https://github.com/vllm-project/vllm-omni/pull/1497
* [Bugfix] Fix cpu offload and quantization compatibility by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1473
* [Feat] support SP for FLUX.2-klein by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1250
* [CI]: Add/Fix bagel e2e online/offline test by @princepride in https://github.com/vllm-project/vllm-omni/pull/1895
* [Feat] support HSDP for Flux family by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1900
* Add `Governance` section by @ywang96 in https://github.com/vllm-project/vllm-omni/pull/1889
* Update latest news section in README.md by @ywang96 in https://github.com/vllm-project/vllm-omni/pull/1909
* [Feature] Split #1303 Part 1: PD disaggregation scaffolding by @ahengljh in https://github.com/vllm-project/vllm-omni/pull/1863
* [NPU] Upgrade to v0.17.0 by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1890
* [Misc] removed qwen3_tts.py as it is out-dated by @lengrongfu in https://github.com/vllm-project/vllm-omni/pull/1926
* [Bug][Qwen3TTS][Streaming] remove dynamic initial chunk and only compute on initial request by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/1930
* Fix Base voice clone streaming quality and stop-token crash by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1945
* [Docs] Update WeChat QR code for community support by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1974
* [skip ci][Docs] Update WeChat QR code (fix filename case) by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1976
* [Entrypoint][Refactor] vLLM-Omni Entrypoint Refactoring by @fake0fan in https://github.com/vllm-project/vllm-omni/pull/1908
* [Bugfix] Set PREEMPTED status when moving requests from running to waiting queue by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/1893
* [Feature] Add cache-dit support for HunyuanImage3 by @Fishermanykx in https://github.com/vllm-project/vllm-omni/pull/1848
* [Feature]: Remove some useless `hf_overrides` in yaml by @princepride in https://github.com/vllm-project/vllm-omni/pull/1898
* [CI] Nightly Benchmark - Add an HTML generator, Update the EXCEL generator. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1831
* [Bug]: fix CUDA OOM during diffusion post-processing by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1670
* [Optim][Qwen3TTS] big boost model throughput+latency high concurrency by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/1852
* [CI] [ROCm] Bugfix device environment issue by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/1984
* [CI]init intel ci dispatch in buildkite folder by @xuechendi in https://github.com/vllm-project/vllm-omni/pull/1721
* Fix OmniGen2 transformer config loading for HF models by @Joshna-Medisetty in https://github.com/vllm-project/vllm-omni/pull/1934
* [Test] L4 complete diffusion feature test for Bagel models by @NumberWan in https://github.com/vllm-project/vllm-omni/pull/1938
* [Performance] diffusion timing by @Bounty-hunter in https://github.com/vllm-project/vllm-omni/pull/1757
* [Perf] [Qwen3-TTS] Keep audio_codes and last_talker_hidden on GPU to eliminate per-step sync stalls by @DomBrown in https://github.com/vllm-project/vllm-omni/pull/1985
* [CI] Split BAGEL tests into dummy/real weight tiers (L2/L3) by @princepride in https://github.com/vllm-project/vllm-omni/pull/1998
* [Bugfix] Fix config misalignment between offline and online diffusion inference (Wan2.2, Qwen-Image series) by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/1979
* Add HF token to H100 jobs by @khluu in https://github.com/vllm-project/vllm-omni/pull/2008
* [Bugfix] Fix Ovis Image crash when guidance_scale is set without negative_prompt by @Dnoob in https://github.com/vllm-project/vllm-omni/pull/1956
* [Bugfix] fix helios video generate use cpu device by @lengrongfu in https://github.com/vllm-project/vllm-omni/pull/1915
* [XPU] update bagel modeling to remove cuda hardcode, add xpu stage_config by @xuechendi in https://github.com/vllm-project/vllm-omni/pull/1931
* [Fix] Fix slow hasattr in CUDAGraphWrapper.__getattr__ by @ZeldaHuang in https://github.com/vllm-project/vllm-omni/pull/1982
* [Bugfix] revert PR#1758 which introduced the accuracy problem of qwen3-omni by @R2-Y in https://github.com/vllm-project/vllm-omni/pull/2009
* [Bugfix]Fix bug of online server can not return mutli images by @Hu1Lcode in https://github.com/vllm-project/vllm-omni/pull/2007
* [CI] [ROCm] Setup `test-ready.yml` and `test-merge.yml` by @tjtanaa in https://github.com/vllm-project/vllm-omni/pull/2017
* Int8 Quantization Support for DiT (Z-Image & Qwen-Image) by @yjb767868009 in https://github.com/vllm-project/vllm-omni/pull/1470
* [Model] Add Voxtral TTS model by @y123456y78 in https://github.com/vllm-project/vllm-omni/pull/1803
* [Feat] Support T5 Tensor Parallelism by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/1881
* [Feat][Qwen3TTS][Code2wav] triton SnakeBeta and Cuda Graph by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/1797
* [Optim][Qwen3TTS][CodePredictor] support torch.compile with reduce-overhead and dynamic False by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/1913
* [CI] Change Bagel online test environment variable `VLLM_TEST_CLEAN_GPU_MEMORY` to `0` by @princepride in https://github.com/vllm-project/vllm-omni/pull/2032
* [BugFix][Doc]Update voxtral_tts end2end.py & README.md by @y123456y78 in https://github.com/vllm-project/vllm-omni/pull/2026
* [Docs] Add Wan2.1-T2V as supported video generation models by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/1920
* [Bugfix] Remove duplicated config keyword max batch size by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/1851
* [Test] Implement mock HTTP request handling in benchmark CLI tests by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/2014
* [CI] Fix test. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/2031
* reafator pipeline stage/step pipeline by @asukaqaq-s in https://github.com/vllm-project/vllm-omni/pull/1368
* [Fixbug][Perf] Qwen3-omni: code predictor with re-prefill + SDPA and eliminate decode hot-path CPU round-trips by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/2012
* [Benchmark] [Diffusion] [Enhancement] Random dataset by @Bounty-hunter in https://github.com/vllm-project/vllm-omni/pull/1657
* [Bugfix] Z-Image CFG threshold should be > 0 instead of > 1 by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1634
* [Voxtral TTS] Remove redundant yaml by @y123456y78 in https://github.com/vllm-project/vllm-omni/pull/2056
* [Bugfix]: fixed ServerDisconnectedError in benchmark test (reapply #1683, fixes #1374) by @NumberWan in https://github.com/vllm-project/vllm-omni/pull/1841
* [Perf] Improve Fish Speech S2 Pro inference performance by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/1859
* [Voxtral] Improve example by @patrickvonplaten in https://github.com/vllm-project/vllm-omni/pull/2045
* [CI] Uncomment condition for nightly build in YAML by @Gaohan123 in https://github.com/vllm-project/vllm-omni/pull/2057
* [bugfix] /chat/completion doesn't read extra_body for diffusion model by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/2042
* [BugFix][Qwen3TTS] CodePredictor CudaGraph Pool by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/2059
* [Rebase] Rebase to vllm v0.18.0 by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/2037
* [Doc] Update docs and dockerfiles for rebase of vllm v0.18.0 by @tzhouam in https://github.com/vllm-project/vllm-omni/pull/2038
* [Model] Add HunyuanVideo-1.5 T2V and I2V support by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1516
* [Bugfix] Fix Fish Speech and CosyVoice3 online serving - missing is_comprehension and broken model detection by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/2058
* Remove mm_prefix_lm patch because vllm==0.18.0 already support by @princepride in https://github.com/vllm-project/vllm-omni/pull/2062
* [Bugfix] Fix HunyuanVideo-1.5 CI failures by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/2066
* [Voxtral] Fix Voxtral TTS end2end.py by @y123456y78 in https://github.com/vllm-project/vllm-omni/pull/2067
* [FP8] enable hunyuan-image-3 diffusion model with fp8 online quant by @xuechendi in https://github.com/vllm-project/vllm-omni/pull/1935
* [CI] Add Flux2 Klein Tests by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/2027
* [Bugfix] Restore chunk-waiting requests on OmniNewRequestData rewrap failure by @dubin555 in https://github.com/vllm-project/vllm-omni/pull/1691
* [Fix] Fix non-unique request IDs in /v1/images/edits endpoint by @zJuuu in https://github.com/vllm-project/vllm-omni/pull/2050
* [Bugfix] Fix cache-dit for single-transformer Wan2.2 models(eg. Wan2.2-TI2V-5B) by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1392
* [Core] Simplify OmniModelConfig Initialization by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/1768
* Upgrade GitHub Actions for Node 24 compatibility by @salmanmkc in https://github.com/vllm-project/vllm-omni/pull/2070
* [BugFix]: Fix OmniGen2 Model Loading by @legitnull in https://github.com/vllm-project/vllm-omni/pull/1711
* [Feat] support TeaCache for Flux2 klein by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1234
* [Feature] add Tensor Parallelism to Omnigen2 by @zzhuoxin1508 in https://github.com/vllm-project/vllm-omni/pull/2065
* [Bugfix] fix gguf TypeError: GGUFConfig.get_name() missing 1 required positional argument: 'self', test: add diffusion gguf unit coverage by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1865
* [Docs][CI] doc update & L4 example test for text-to-image page by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/1910
* [Bugfix] Fix NPU Hunyuan fused MoE forward context after rebase to 0.18.0 by @Fishermanykx in https://github.com/vllm-project/vllm-omni/pull/2091
* [Feature][RL] Support batching for QwenImage in async mode by @knlnguyen1802 in https://github.com/vllm-project/vllm-omni/pull/1593
* [Test] L5 Long-Term Stability Test and GPU Memory Monitoring Main L5 last by @zhumingjue138 in https://github.com/vllm-project/vllm-omni/pull/1799
* [CI] Update Diffusion Model Test Configuration for Nightly Builds by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/2086
* [Refactor] Refactor Diffusion Scheduler/Executor Boundaries and Request State Flow by @yJader in https://github.com/vllm-project/vllm-omni/pull/1625
* [Quantization] feat: add qwen-image gguf adapter by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1755
* [Bagel]: Support SP by @princepride in https://github.com/vllm-project/vllm-omni/pull/1903
* [Feat] Phase 1 foundation types for multimodal output decoupling by @meghaagr13 in https://github.com/vllm-project/vllm-omni/pull/1816
* [Unit Test] add unit tests for AsyncOmni and Omni by @yinpeiqi in https://github.com/vllm-project/vllm-omni/pull/2034
* [Perf] Qwen-Image Performance Nightly CI test by @wtomin in https://github.com/vllm-project/vllm-omni/pull/1805
* [Bugfix] Fix Qwen-Image SP and TeaCache incompatibility by @wtomin in https://github.com/vllm-project/vllm-omni/pull/2101
* [Bugfix][Chunk Transfer Adapter] deque mutated fix  by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/2102
* [model] support FLUX.1-Kontext-dev by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/561
* [Doc] Sync and fix. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/2110
* [Feat] support TP for GLM-Image by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1918
* [Feat][Qwen3-TTS] Better Qwen3-TTS online serving demo by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1857
* Add tool to configure gpu_memory_utilization for multi-stage pipelines by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/1958
* [BugFIX] enable Hunyuan image3 with stage selection among text_to_image/image_to_text by @xuechendi in https://github.com/vllm-project/vllm-omni/pull/1826
* [feature] stable_audio_open_1 teacache support by @akshatvishu in https://github.com/vllm-project/vllm-omni/pull/1314
* [Feature] Add a extra body param in create video api by @lengrongfu in https://github.com/vllm-project/vllm-omni/pull/1955
* [Bugfix] Support base64 input for --ref-audio in Qwen3-TTS client by @lolyhop in https://github.com/vllm-project/vllm-omni/pull/1389
* [Feature] support to change the speaker of qwen3-omni by @R2-Y in https://github.com/vllm-project/vllm-omni/pull/1963
* [skip ci] Keep the latest version. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/2112
* [Enhancement] Add force_refresh support for GLM-Image for cache-dit 1.3.0 upgrade by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/1858
* [Bugfix] fix offload and hsdp incompatibility by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1888
* [Feature]: add Ulysses advanced_uaa mode by @dongbo910220 in https://github.com/vllm-project/vllm-omni/pull/1379
* [Test] L4 complete diffusion feature test for Qwen-Image-Layered models by @kechengliu97 in https://github.com/vllm-project/vllm-omni/pull/2085
* [Refactor] Unify torch profiler for omni and diffusion models by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/2099
* [API] Add layers and resolution parameters to /v1/images/edits endpoint by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/2053
* [CI] [RL]: Add e2e test for custom pipeline  by @knlnguyen1802 in https://github.com/vllm-project/vllm-omni/pull/2005
* [Perf] Qwen-Image Nightly Performance CI Improvement by @wtomin in https://github.com/vllm-project/vllm-omni/pull/2111
* [CI] Add conditions for L3 (tests after merging) and L4 (tests for nightly). by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1514
* [Enhancement] Custom chunk_size for mimo-audio model by @qibaoyuan in https://github.com/vllm-project/vllm-omni/pull/1964
* [CI] Trigger nightly diffusion benchmark collects and html generates. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/1995
* [Core] Unified quantization framework by @lishunyang12 in https://github.com/vllm-project/vllm-omni/pull/1764
* [Fix CI] Reduce num gpus to prevent ci failure by @wtomin in https://github.com/vllm-project/vllm-omni/pull/2131
* [Feat] Support scalar types in AdditionalInformationEntry by @NickCao in https://github.com/vllm-project/vllm-omni/pull/2105
* [Docs][skip ci] Fix omni and tts docs by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/2130
* [Bugfix] Fix high TTFP for Base task in Gradio TTS demo by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/2116
* [Feature] Speech batch entrypoint by @divyanshsinghvi in https://github.com/vllm-project/vllm-omni/pull/1701
* [Bugfix] Fix memory leak: missing chunk_transfer_adapter.cleanup() in OmniARScheduler by @dubin555 in https://github.com/vllm-project/vllm-omni/pull/2028
* [Fix] Qwen3 TTS audio handling for long ref_audio by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/2104
* [CI/Build] Fix Doc 404s by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/2155
* [Voxtral TTS] Add multilingual support in gradio demo by @y123456y78 in https://github.com/vllm-project/vllm-omni/pull/2151
* Add TTS Text Preprocessing to Gradio Demo by @rohinarora73 in https://github.com/vllm-project/vllm-omni/pull/2152
* [Docs] Update WeChat QR code for community support by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/2165
* [Voxtral TTS] Use 8 step flow matching instead of 16 by @y123456y78 in https://github.com/vllm-project/vllm-omni/pull/2158
* [CI] Add online e2e test for qwen2.5 omni by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/1668
* [Test] Add L4 diffusion feature test for LongCat-Image by @lcukyfuture in https://github.com/vllm-project/vllm-omni/pull/1970
* [DOC] intel GPU model support list by @xuechendi in https://github.com/vllm-project/vllm-omni/pull/2154
* [Test] L4 complete diffusion feature test for LongCat Image Edit models by @NumberWan in https://github.com/vllm-project/vllm-omni/pull/2035
* [CI] Fix examples tests error by @zhumingjue138 in https://github.com/vllm-project/vllm-omni/pull/2138
* [Fixbug] increase qwen2 5 online test timeout limit by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/2171
* [Docs] refine UAA documentation by @dongbo910220 in https://github.com/vllm-project/vllm-omni/pull/2148
* [CI] Add Stable Diffusion 3.5 Tests by @spencerr221 in https://github.com/vllm-project/vllm-omni/pull/2120
* [Cleanup] Remove stray test file from engine directory by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/2161
* [Bug-Fix]fix bug of empty prompt input by @Hu1Lcode in https://github.com/vllm-project/vllm-omni/pull/2041
* [BugFix] Make Stage Device Initialization Respect Visible GPUs by @alex-jw-brooks in https://github.com/vllm-project/vllm-omni/pull/2025
* [Test] Add Qwen-tts test cases and unify the style of existing test cases by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/1911
* [Perf] [TTS] Improve Fish Speech S2 Pro voice cloning TTFP by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/2145
* Revert "[Test] Add Qwen-tts test cases and unify the style of existing test cases" by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/2192
* [CI] Skip test_sd3_expansion due to CI failure 5148 by @Gaohan123 in https://github.com/vllm-project/vllm-omni/pull/2191
* [Frontend] Speaker embedding support for speech and voices APIs by @marksverdhei in https://github.com/vllm-project/vllm-omni/pull/1227
* [Bugfix] add inject model_arch to hf_overrides by @lengrongfu in https://github.com/vllm-project/vllm-omni/pull/2178
* [CI] Add nightly-test label trigger. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/2172
* [Bugfix] resolve stage config for GLM-Image with diffusers format by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/1894
* [Bugfix] Maintain model-level CPU offload in a blocking way by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/1978
* [skip ci][Docs] Add FlashAttention requirement for audio generation to prevent noise-only outputs in mimo-audio model by @qibaoyuan in https://github.com/vllm-project/vllm-omni/pull/2205
* [Test]Add FLUX.2-dev online serving expansion test by @yangjianjuan in https://github.com/vllm-project/vllm-omni/pull/2174
* [Bugfix] Fix qwen3-omni async thinker to talker decode alignment for #1758 by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/2019
* [Fix] [skip ci] Fix path. by @congw729 in https://github.com/vllm-project/vllm-omni/pull/2204
* [Bugfix] remove default sampling parameters by @R2-Y in https://github.com/vllm-project/vllm-omni/pull/2173
* [BugFix]Fix keyError: num_processed_tokens_delta by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/2213
* [Enhancement] Patch AsyncOmniEngine try_get_output[_async] hanging issues by @pi314ever in https://github.com/vllm-project/vllm-omni/pull/2153
* [Accuracy Benchmark] feat: add accuracy benchmark integrations for t2i and i2i by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/1917
* [Test] L4 complete diffusion feature test for Wan2.2 models by @bjf-frz in https://github.com/vllm-project/vllm-omni/pull/2087
* [Bug Fix] GLM-Image stage device isolation and t2i prompt preprocessing in Omni runtime by @JaredforReal in https://github.com/vllm-project/vllm-omni/pull/2137
* [CI] qwen2.5-omni model cannot recognize the synthetic video by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/2211
* [Bugfix] Fix Voxtral TTS voice embeddings not loading by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/2156
* [CI] fix Wan22 timeout and i2i accuracy threshold by @david6666666 in https://github.com/vllm-project/vllm-omni/pull/2235
* [Qwen3TTS][ServingSpeech] Bugfix/voice upload and add optional ref_text by @JuanPZuluaga in https://github.com/vllm-project/vllm-omni/pull/2046
* [Doc] Improve diffusion generation parameter docs for online serving by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/2051
* [Bugfix] Fix diffusion benchmark issues #1873 by @Dnoob in https://github.com/vllm-project/vllm-omni/pull/1897
* [Compatibility] Add Multiple Attention Backends Support in MIMO-Audio Tokenizer by @qibaoyuan in https://github.com/vllm-project/vllm-omni/pull/2225
* [Bug Fix] Resolve broken image issue when TP is enabled and no seed is provided. by @zhtmike in https://github.com/vllm-project/vllm-omni/pull/2176
* [Test] L4 complete diffusion feature test for Z-Image by @yinpeiqi in https://github.com/vllm-project/vllm-omni/pull/2132
* [CI] Increase diffusion initialization timeout from 600 to 700 seconds in online serving tests by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/2230
* [CI] Add Voxtral TTS e2e test by @y123456y78 in https://github.com/vllm-project/vllm-omni/pull/2023
* [Bugfix] Fix tp and Quantization incompatible for Flux by @RuixiangMa in https://github.com/vllm-project/vllm-omni/pull/2180
* [CI] Skip tests due to L3 CI failure by @Gaohan123 in https://github.com/vllm-project/vllm-omni/pull/2245
* Frontend] Support --dtype in qwen3_omni offline e2e script by @reidliu41 in https://github.com/vllm-project/vllm-omni/pull/2246
* [BugFix][Qwen3-Omni]Fixed the issue of incorrect answers for single words. by @amy-why-3459 in https://github.com/vllm-project/vllm-omni/pull/2239
* [Test] L4 complete diffusion feature test for Qwen-Image models by @SamitHuang in https://github.com/vllm-project/vllm-omni/pull/1869
* [Bugfix] Fix dynamic function call on collective_rpc of DiffusionWorker by @knlnguyen1802 in https://github.com/vllm-project/vllm-omni/pull/2217
* [Bugfix]fix_test_bagel_online by @bjf-frz in https://github.com/vllm-project/vllm-omni/pull/2237
* [CI] Add sd3 for test by @spencerr221 in https://github.com/vllm-project/vllm-omni/pull/2219
* [CI] Add online e2e test for MIMO-Audio by @LJH-LBJ in https://github.com/vllm-project/vllm-omni/pull/2129
* [CI] remove benchmark/testing comparison w/ other frameworks by @fhfuih in https://github.com/vllm-project/vllm-omni/pull/2179
* [Feature] support sp for hunyuan by @Bounty-hunter in https://github.com/vllm-project/vllm-omni/pull/2163
* [Bugfix] Modify conftest.py set unspecified parameters by @bjf-frz in https://github.com/vllm-project/vllm-omni/pull/2263
* [Release] Upgrade NPU dockerfile & docs for v0.18.0 by @gcanlin in https://github.com/vllm-project/vllm-omni/pull/2271
* [CI] Update pytest command to exclude specific test in nightly build by @yenuo26 in https://github.com/vllm-project/vllm-omni/pull/2272
* [bugfix] Remove duplicate yaml entry by @pi314ever in https://github.com/vllm-project/vllm-omni/pull/2279
* [Bugfix] Fix Fish Speech S2 Pro prompt handling for truncated audio & emotion tag by @Sy0307 in https://github.com/vllm-project/vllm-omni/pull/2268
* [Misc] Clean up unused diffusion timing args in examples by @yuanheng-zhao in https://github.com/vllm-project/vllm-omni/pull/2266
* [Qwen3TTS][Bugfix] Replace vLLM fused layers with HF-compatible numerics in code predictor by @linyueqian in https://github.com/vllm-project/vllm-omni/pull/2277

## New Contributors
* @lengrongfu made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1566
* @ZhanqiuHu made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1619
* @usberkeley made their first contribution in https://github.com/vllm-project/vllm-omni/pull/759
* @HonestDeng made their first contribution in https://github.com/vllm-project/vllm-omni/pull/336
* @jiangmengyu18 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1537
* @pi314ever made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1677
* @Lidang-Jiang made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1687
* @JackLeeHal made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1197
* @dubin555 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1614
* @RomanKoshkin made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1417
* @SHYuanBest made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1729
* @zhaotyer made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1201
* @oglok made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1337
* @NumberWan made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1465
* @Flink-ddd made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1582
* @ieaves made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1665
* @ahengljh made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1863
* @Fishermanykx made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1848
* @Joshna-Medisetty made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1934
* @DomBrown made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1985
* @Dnoob made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1956
* @Hu1Lcode made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2007
* @yjb767868009 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1470
* @y123456y78 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1803
* @patrickvonplaten made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2045
* @zJuuu made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2050
* @salmanmkc made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2070
* @meghaagr13 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1816
* @akshatvishu made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1314
* @lolyhop made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1389
* @NickCao made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2105
* @rohinarora73 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2152
* @lcukyfuture made their first contribution in https://github.com/vllm-project/vllm-omni/pull/1970
* @spencerr221 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2120
* @yangjianjuan made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2174
* @bjf-frz made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2087
* @zhtmike made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2176
* @reidliu41 made their first contribution in https://github.com/vllm-project/vllm-omni/pull/2246

**Full Changelog**: https://github.com/vllm-project/vllm-omni/compare/v0.16.0...v0.18.0