v0.11.0

vllm-project/vllmv0.11.0Oct 2, 2025by simon-mo

AI Summary

Marks the end of V0 engine support and turns on FULL_AND_PIECEWISE CUDA graph mode by default.

Key Highlights

  • V0 engine removal (V1 is the only engine in codebase)
  • CUDA graph mode default change (FULL_AND_PIECEWISE)
  • New models: DeepSeek-V3.2, Qwen3-VL, Qwen3-Next, OLMo3
  • Engine Core: KV offloading and Prompt embeddings

Breaking Changes

  • V0 engine removal (AsyncLLMEngine, LLMEngine, etc.)
  • CUDA graph mode default change
  • PyTorch 2.8 for CPU

New Features

  • New model architectures: LongCat-Flash, Dots OCR
  • Speculative decoding: EAGLE3 for MiniCPM3
  • Engine Core: Hybrid allocator, Triton attention
  • Hardware: NVIDIA FP8 FlashInfer MLA
  • API: OpenAI prompt logprobs support

Full Release Notes

## Highlights
This release features 538 commits, 207 contributors (65 new contributors)!

* This release completes the removal of V0 engine. V0 engine code including AsyncLLMEngine, LLMEngine, MQLLMEngine, all attention backends, and related components have been removed. **V1 is the only engine in the codebase now.**
* This releases turns on **FULL_AND_PIECEWISE as the CUDA graph mode default**. This should provide better out of the box performance for most models, particularly fine-grained MoEs, while preserving compatibility with existing models supporting only PIECEWISE mode.

Note: In v0.11.0 (and v0.10.2), `--async-scheduling` will produce gibberish output in some cases such as preemption and others. This functionality is correct in v0.10.1. We are actively fixing it for the next version. 

### Model Support
* New architectures: DeepSeek-V3.2-Exp (#25896), Qwen3-VL series (#24727), Qwen3-Next (#24526), OLMo3 (#24534), LongCat-Flash (#23991), Dots OCR (#24645), Ling2.0 (#24627), CWM (#25611).
* Encoders: RADIO encoder support (#24595), Transformers backend support for encoder-only models (#25174).
* Task expansion: BERT token classification/NER (#24872), multimodal models for pooling tasks (#24451).
* Data parallel for vision encoders: InternVL (#23909), Qwen2-VL (#25445), Qwen3-VL (#24955).
* Speculative decoding: EAGLE3 for MiniCPM3 (#24243) and GPT-OSS (#25246).
* Features: Qwen3-VL text-only mode (#26000), EVS video token pruning (#22980), Mamba2 TP+quantization (#24593), MRoPE + YaRN (#25384), Whisper on XPU (#25123), LongCat-Flash-Chat tool calling (#24083).
* Performance: GLM-4.1V 916ms TTFT reduction via fused RMSNorm (#24733), GLM-4 MoE SharedFusedMoE optimization (#24849), Qwen2.5-VL CUDA sync removal (#24741), Qwen3-VL Triton MRoPE kernel (#25055), FP8 checkpoints for Qwen3-Next (#25079).
* Reasoning: SeedOSS reason parser (#24263).

### Engine Core
* KV cache offloading: CPU offloading with LRU management (#19848, #20075, #21448, #22595, #24251).
* V1 features: Prompt embeddings (#24278), sharded state loading (#25308), FlexAttention sliding window (#24089), LLM.apply_model (#18465).
* Hybrid allocator: Pipeline parallel (#23974), varying hidden sizes (#25101).
* Async scheduling: Uniprocessor executor support (#24219).
* Architecture: Tokenizer group removal (#24078), shared memory multimodal caching (#20452).
* Attention: Hybrid SSM/Attention in Triton (#21197), FlashAttention 3 for ViT (#24347).
* Performance: FlashInfer RoPE 2x speedup (#21126), fused Q/K RoPE 11% improvement (#24511, #25005), 8x spec decode overhead reduction (#24986), FlashInfer spec decode with 1.14x speedup (#25196), model info caching (#23558), inputs_embeds copy avoidance (#25739).
* LoRA: Optimized weight loading (#25403).
* Defaults: CUDA graph mode FULL_AND_PIECEWISE (#25444), Inductor standalone compile disabled (#25391).
* torch.compile: CUDA graph Inductor partition integration (#24281).

### Hardware & Performance
* NVIDIA: FP8 FlashInfer MLA decode (#24705), BF16 fused MoE for Hopper/Blackwell expert parallel (#25503).
* DeepGEMM: Enabled by default (#24462), 5.5% throughput improvement (#24783).
* New architectures: RISC-V 64-bit (#22112), ARM non-x86 CPU (#25166), ARM 4-bit fused MoE (#23809).
* AMD: ROCm 7.0 (#25178), GLM-4.5 MI300X tuning (#25703).
* Intel XPU: MoE DP accuracy fix (#25465).

### Large Scale Serving & Performance
* Dual-Batch Overlap (DBO): Overlapping computation mechanism (#23693), DeepEP high throughput + prefill (#24845).
* Data Parallelism: torchrun launcher (#24899), Ray placement groups (#25026), Triton DP/EP kernels (#24588).
* EPLB: Hunyuan V1 (#23078), Mixtral (#22842), static placement (#23745), reduced overhead (#24573).
* Disaggregated serving: KV transfer metrics (#22188), NIXL MLA latent dimension (#25902).
* MoE: Shared expert overlap optimization (#24254), SiLU kernel for DeepSeek-R1 (#24054), Enable Allgather/ReduceScatter backend for NaiveAllToAll (#23964).
* Distributed: NCCL symmetric memory with 3-4% throughput improvement (#24532), enabled by default for TP (#25070).

### Quantization
* FP8: Per-token-group quantization (#24342), hardware-accelerated instructions (#24757), torch.compile KV cache (#22758), paged attention update (#22222).
* FP4: NVFP4 for dense models (#25609), Gemma3 (#22771), Llama 3.1 405B (#25135).
* W4A8: Faster preprocessing (#23972).
* Compressed tensors: Blocked FP8 for MoE (#25219).

### API & Frontend
* OpenAI: Prompt logprobs for all tokens (#24956), logprobs=-1 for full vocab (#25031), reasoning streaming events (#24938), Responses API MCP tools (#24628, #24985), health 503 on dead engine (#24897).
* Multimodal: Media UUID caching (#23950), image path format (#25081).
* Tool calling: XML parser for Qwen3-Coder (#25028), Hermes-style tokens (#25281).
* CLI: --enable-logging (#25610), improved --help (#24903).
* Config: Speculative model engine args (#25250), env validation (#24761), NVTX profiling (#25501), guided decoding backward compatibility (#25615, #25422).
* Metrics: V1 TPOT histogram (#24015), hidden deprecated gpu_ metrics (#24245), KV cache GiB units (#25204, #25479).
* UX: Removed misleading quantization warning (#25012).

### Security
* https://github.com/vllm-project/vllm/security/advisories/GHSA-wr9h-g72x-mwhm

### Dependencies
* PyTorch 2.8 for CPU (#25652), FlashInfer 0.3.1 (#24470), CUDA 13 (#24599), ROCm 7.0 (#25178).
* **Build requirements**: C++17 now enforced globally (#24823).
* **TPU**: Deprecated `xm.mark_step` in favor of `torch_xla.sync` (#25254).

### V0 Deprecation
* Engines: AsyncLLMEngine (#25025), LLMEngine (#25033), MQLLMEngine (#25019), core (#25321), model runner (#25328), MP executor (#25329).
* Components: Attention backends (#25351), encoder-decoder (#24907), output processor (#25320), sampling metadata (#25345), Sequence/Sampler (#25332).
* Interfaces: LoRA (#25686), async output processor (#25334), MultiModalPlaceholderMap (#25366), seq group methods (#25330), placeholder attention (#25510), input embeddings (#25242), multimodal registry (#25362), max_seq_len_to_capture (#25543), attention classes (#25541), hybrid models (#25400), backend suffixes (#25489), compilation fallbacks (#25675), default args (#25409).

## What's Changed
* [Qwen3-Next] MoE configs for H20 TP=1,2,4,8 by @jeejeelee in https://github.com/vllm-project/vllm/pull/24707
* [DOCs] Update ROCm installation docs section by @gshtras in https://github.com/vllm-project/vllm/pull/24691
* Enable conversion of multimodal models to pooling tasks by @maxdebayser in https://github.com/vllm-project/vllm/pull/24451
* Fix implementation divergence for BLOOM models between vLLM and HuggingFace when using prompt embeds by @qthequartermasterman in https://github.com/vllm-project/vllm/pull/24686
* [Bugfix] Fix MRoPE dispatch on CPU by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/24712
* [BugFix] Fix Qwen3-Next PP by @njhill in https://github.com/vllm-project/vllm/pull/24709
* [CI] Fix flaky test  v1/worker/test_gpu_model_runner.py::test_kv_cache_stride_order          by @heheda12345 in https://github.com/vllm-project/vllm/pull/24640
* [CI] Add ci_envs for convenient local testing by @noooop in https://github.com/vllm-project/vllm/pull/24630
* [CI/Build] Skip prompt embeddings tests on V1-only CPU backend by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/24721
* [Misc][gpt-oss] Add gpt-oss label to PRs that mention harmony or related to builtin tool call by @heheda12345 in https://github.com/vllm-project/vllm/pull/24717
* [Bugfix] Fix BNB name match by @jeejeelee in https://github.com/vllm-project/vllm/pull/24735
* [Kernel] [CPU] refactor `cpu_attn.py:_run_sdpa_forward` for better memory access by @ignaciosica in https://github.com/vllm-project/vllm/pull/24701
* [sleep mode] save memory for on-the-fly quantization by @youkaichao in https://github.com/vllm-project/vllm/pull/24731
* [Multi Modal] Add FA3 in VIT by @wwl2755 in https://github.com/vllm-project/vllm/pull/24347
* [Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec  by @sfeng33 in https://github.com/vllm-project/vllm/pull/24548
* [Doc]: fix typos in various files by @didier-durand in https://github.com/vllm-project/vllm/pull/24726
* [Docs] Fix warnings in mkdocs build (continued) by @Zerohertz in https://github.com/vllm-project/vllm/pull/24740
* [Bugfix] Fix MRoPE dispatch on XPU by @yma11 in https://github.com/vllm-project/vllm/pull/24724
* [Qwen3-Next] MoE configs for H100 TP=1,2 and TP2/EP by @elvircrn in https://github.com/vllm-project/vllm/pull/24739
* [Core] Shared memory based object store for Multimodal data caching and IPC by @dongluw in https://github.com/vllm-project/vllm/pull/20452
* [Bugfix][Frontend] Fix `--enable-log-outputs` does not match the documentation by @kebe7jun in https://github.com/vllm-project/vllm/pull/24626
* [Models] Optimise and simplify `_validate_and_reshape_mm_tensor` by @lgeiger in https://github.com/vllm-project/vllm/pull/24742
* [Models] Prevent CUDA sync in Qwen2.5-VL by @lgeiger in https://github.com/vllm-project/vllm/pull/24741
* [Model] Switch to Fused RMSNorm in GLM-4.1V model by @SamitHuang in https://github.com/vllm-project/vllm/pull/24733
* [UX] Remove AsyncLLM torch profiler disabled log by @mgoin in https://github.com/vllm-project/vllm/pull/24609
* [CI] Speed up model unit tests in CI by @afeldman-nm in https://github.com/vllm-project/vllm/pull/24253
* [Bugfix] Fix incompatibility between #20452 and #24548 by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/24754
* [CI] Trigger BC Linter when labels are added/removed by @zhewenl in https://github.com/vllm-project/vllm/pull/24767
* [Benchmark] Allow arbitrary headers to be passed to benchmarked endpoints by @smarterclayton in https://github.com/vllm-project/vllm/pull/23937
* [Compilation Bug] Fix Inductor Graph Output with Shape Issue by @yewentao256 in https://github.com/vllm-project/vllm/pull/24772
* Invert pattern order to make sure that out_proj layers are identified by @anmarques in https://github.com/vllm-project/vllm/pull/24781
* [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode by @MatthewBonanni in https://github.com/vllm-project/vllm/pull/24705
* Add FLASHINFER_MLA to backend selector test by @MatthewBonanni in https://github.com/vllm-project/vllm/pull/24753
* [Qwen3Next] Fixes the cuda graph capture conditions under large batch sizes (#24660) by @sighingnow in https://github.com/vllm-project/vllm/pull/24667
* [Core] Support async scheduling with uniproc executor  by @njhill in https://github.com/vllm-project/vllm/pull/24219
* [Frontend][Multimodal] Allow skipping media data when UUIDs are provided.  by @huachenheli in https://github.com/vllm-project/vllm/pull/23950
* [Model] Add Olmo3 model implementation by @2015aroras in https://github.com/vllm-project/vllm/pull/24534
* [Bugfix] Fix GPUModelRunner has no attribute lora_manager by @jeejeelee in https://github.com/vllm-project/vllm/pull/24762
* [Chore] Remove unused batched RoPE op & kernel by @WoosukKwon in https://github.com/vllm-project/vllm/pull/24789
* [Docs] Fix warnings in mkdocs build (continued) by @Zerohertz in https://github.com/vllm-project/vllm/pull/24791
* [Docs] Remove Neuron install doc as backend no longer exists by @hmellor in https://github.com/vllm-project/vllm/pull/24396
* [Doc]: Remove 404 hyperlinks by @rozeappletree in https://github.com/vllm-project/vllm/pull/24785
* [Perf] Use NVIDIA hardware-accelerated instruction for float to fp8_e4m3 quantization by @elvischenv in https://github.com/vllm-project/vllm/pull/24757
* [Kernels][DP/EP] Optimize Silu Kernel for R1 by @elvircrn in https://github.com/vllm-project/vllm/pull/24054
* [Core][Multimodal] Cache `supports_kw` by @lgeiger in https://github.com/vllm-project/vllm/pull/24773
* [CI Failure] Fix test_flashinfer_cutlass_mxfp4_mxfp8_fused_moe by @mgoin in https://github.com/vllm-project/vllm/pull/24750
* [Misc] Correct an outdated comment. by @russellb in https://github.com/vllm-project/vllm/pull/24765
* [Doc]: fix typos in various files by @didier-durand in https://github.com/vllm-project/vllm/pull/24798
* [CI][Spec Decode] Adjust threshold for flaky ngram spec decoding test again by @wwl2755 in https://github.com/vllm-project/vllm/pull/24771
* Remove redundant assignment in xfer_buffers, This is a little fix by @ChenTaoyu-SJTU in https://github.com/vllm-project/vllm/pull/24732
* [Minor] Simplify duplicative device check for cuda by @ziliangpeng in https://github.com/vllm-project/vllm/pull/24793
* [Chore] Minor simplification for non-PP path by @WoosukKwon in https://github.com/vllm-project/vllm/pull/24810
* [Multi Modal][Performance] Fused Q,K's apply_rope into one by @wwl2755 in https://github.com/vllm-project/vllm/pull/24511
* [Misc] Improve `s3_utils` type hints with `BaseClient` by @Zerohertz in https://github.com/vllm-project/vllm/pull/24825
* [Perf] Fix DeepGEMM Contiguous Layout Issue, 5.5% Throughput Improvement by @yewentao256 in https://github.com/vllm-project/vllm/pull/24783
* fix type of sampling rate for encode_base64 by @co63oc in https://github.com/vllm-project/vllm/pull/24826
* [Benchmarks] Throw usage error when using dataset-name random and dataset-path together by @yeqcharlotte in https://github.com/vllm-project/vllm/pull/24819
* Force use C++17 globally to avoid compilation error by @chenfengjin in https://github.com/vllm-project/vllm/pull/24823
* [Chore] Remove ipex_ops warning by @robertgshaw2-redhat in https://github.com/vllm-project/vllm/pull/24835
* [Spec Decoding]Support Spec Decoding Metrics in DP Mode by @wuhang2014 in https://github.com/vllm-project/vllm/pull/24049
* [Hybrid Allocator] Support Pipeline Parallel by @heheda12345 in https://github.com/vllm-project/vllm/pull/23974
* [Docs] Have a try to improve frameworks/streamlit.md by @windsonsea in https://github.com/vllm-project/vllm/pull/24841
* [kv cache] update num_free_blocks in the end by @andyxning in https://github.com/vllm-project/vllm/pull/24228
* [Frontend] Skip `stop` in reasoning content by @gaocegege in https://github.com/vllm-project/vllm/pull/14550
* [Bugfix] MiDashengLM model contact error under concurrent testing by @bingchen-mi in https://github.com/vllm-project/vllm/pull/24738
* [Doc]: fix typos in various files by @didier-durand in https://github.com/vllm-project/vllm/pull/24821
* [Misc] rename interval to max_recent_requests by @andyxning in https://github.com/vllm-project/vllm/pull/24229
* [Misc] Own KVConnectors installation by @NickLucche in https://github.com/vllm-project/vllm/pull/24867
* [P/D]`kv_output_aggregator` support heterogeneous by @LCAIZJ in https://github.com/vllm-project/vllm/pull/23917
* [UT] enhance free kv cache block queue popleft_n by @andyxning in https://github.com/vllm-project/vllm/pull/24220
* [XPU] Set consistent default KV cache layout by @NickLucche in https://github.com/vllm-project/vllm/pull/24745
* [Misc] Fix examples openai_pooling_client.py  by @noooop in https://github.com/vllm-project/vllm/pull/24853
* [Model]: support Ling2.0 by @ant-yy in https://github.com/vllm-project/vllm/pull/24627
* [Bugfix] Fix GLM4.1V multimodal processor with compatability for Transformers v4.56 by @Isotr0py in https://github.com/vllm-project/vllm/pull/24822
* Fp8 paged attention update by @xiao-llm in https://github.com/vllm-project/vllm/pull/22222
* Reinstate existing torch script by @hmellor in https://github.com/vllm-project/vllm/pull/24729
* [USAGE] Improve error handling for weight initialization in Unquantized… by @koiker in https://github.com/vllm-project/vllm/pull/20321
* Move `MultiModalConfig` from `config/__init__.py` to `config/multimodal.py` by @hmellor in https://github.com/vllm-project/vllm/pull/24659
* [Transform] Deterministic Hadacore Transforms by @kylesayrs in https://github.com/vllm-project/vllm/pull/24106
* Update num_tokens_across_dp to use nccl instead of gloo by @SageMoore in https://github.com/vllm-project/vllm/pull/24105
* Bump Flashinfer to 0.3.1 by @bbartels in https://github.com/vllm-project/vllm/pull/24868
* [gpt-oss] Add IncompleteDetails to ResponsesRepsonse by @qandrew in https://github.com/vllm-project/vllm/pull/24561
* [gpt-oss][1a] create_responses stream outputs BaseModel type, api server is SSE still by @qandrew in https://github.com/vllm-project/vllm/pull/24759
* [Performance] Remove redundant clone() calls in cutlass_mla by @alexm-redhat in https://github.com/vllm-project/vllm/pull/24891
* [Bug] Fix Cutlass Scaled MM Compilation Error by @yewentao256 in https://github.com/vllm-project/vllm/pull/24887
* [ci] fix wheel names for arm wheels by @simon-mo in https://github.com/vllm-project/vllm/pull/24898
* [Tests] fix initialization of kv hash in tests by @mickaelseznec in https://github.com/vllm-project/vllm/pull/24273
* [Compile] Fix noop_elimination pass and add tests for noop_elimination by @ZJY0516 in https://github.com/vllm-project/vllm/pull/24880
* `HuggingFace` -> `Hugging Face` in `Integration with Hugging Face` docs by @sergiopaniego in https://github.com/vllm-project/vllm/pull/24889
* Updated CODEOWNERS for flashinfer, mla, fused_moe by @mgoin in https://github.com/vllm-project/vllm/pull/24906
* [Deprecation] Remove DeepGEMM Old Symbol Wrapper by @yewentao256 in https://github.com/vllm-project/vllm/pull/24902
* [ROCm][Bugfix] Fix the case where there's bias by @gshtras in https://github.com/vllm-project/vllm/pull/24895
* Add pytest-cov and .coveragerc by @rzabarazesh in https://github.com/vllm-project/vllm/pull/24778
* [Bug] Fix `is_flashmla_supported` Check Error by @yewentao256 in https://github.com/vllm-project/vllm/pull/24774
* [CI] Small Accuracy Eval Test for Deepseek Model by @yewentao256 in https://github.com/vllm-project/vllm/pull/24259
* [Metrics] Hide deprecated metrics with gpu_ prefix by @markmc in https://github.com/vllm-project/vllm/pull/24245
* [Docs] Update instructions for how to using existing torch binary by @zou3519 in https://github.com/vllm-project/vllm/pull/24892
* Upgrade flashinfer to 0.3.1 by @houseroad in https://github.com/vllm-project/vllm/pull/24470
* [XPU] Fix circular import error.  by @jikunshang in https://github.com/vllm-project/vllm/pull/24927
* Remove V0 Encoder-Decoder Support by @WoosukKwon in https://github.com/vllm-project/vllm/pull/24907
* [Bugfix] Fix sequence parallelism bug when enable pipeline parallelism by @cascade812 in https://github.com/vllm-project/vllm/pull/24021
* [Bug] [Spec Dec]: Fix kv_cache dtype mismatch for Eagle3 drafter on FP8 target by @vllmellm in https://github.com/vllm-project/vllm/pull/24505
* [QWEN NEXT] Fused MoE kernels Optimization configs by @samanamp in https://github.com/vllm-project/vllm/pull/24924
* [benchmark] Add triton version in the moe tuned config by @jeejeelee in https://github.com/vllm-project/vllm/pull/24769
* [Bugfix] remove duplicate tokens streamed in required tool choice streaming by @Jason-CKY in https://github.com/vllm-project/vllm/pull/23312
* [Mamba] Support TP>1 with quantization for mamba2 mixer in case `n_groups % tp_size == 0` by @tomeras91 in https://github.com/vllm-project/vllm/pull/24593
* [Feat][EPLB] A novel static EPLB placement strategy for MoE models. by @cboss6 in https://github.com/vllm-project/vllm/pull/23745
* Move `SpeculativeConfig` from `config/__init__.py` to `config/speculative.py` by @hmellor in https://github.com/vllm-project/vllm/pull/24904
* [Docs] move benchmarks README to contributing guides by @yeqcharlotte in https://github.com/vllm-project/vllm/pull/24820
* feat: Add Grafana and Perces monitoring dashboards for vLLM by @liangwen12year in https://github.com/vllm-project/vllm/pull/23498
* (doc): set cmake c++ compatible standard when building on MacOS CPU. by @teekenl in https://github.com/vllm-project/vllm/pull/23483
* [CI] Add Decode Context Parallelism (DCP) test to CI by @minosfuture in https://github.com/vllm-project/vllm/pull/24487
* [Model] Clean up and simplify Mamba2 Metadata Usage in both V0 and V1 by @cyang49 in https://github.com/vllm-project/vllm/pull/24331
* [Core][MultiModalHasher] Don't convert memoryviews to bytes during hashing by @lgeiger in https://github.com/vllm-project/vllm/pull/24925
* [Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM by @SageMoore in https://github.com/vllm-project/vllm/pull/23693
* [Bugfix] Fix unable to run encoder model when disable_hybrid_kv_cache_manager is true by @lianyiibo in https://github.com/vllm-project/vllm/pull/24571
* [Misc] Add removed encoder-decoder models to previously supported models list by @Isotr0py in https://github.com/vllm-project/vllm/pull/24961
* Directly get max encoder len from VLLM config in V1 by @Sugar-zsg in https://github.com/vllm-project/vllm/pull/24866
* [gpt-oss][1b] streaming add item id, content id by @qandrew in https://github.com/vllm-project/vllm/pull/24788
* [MISC] Add code owners of vllm/v1 to vllm/v1/core by @heheda12345 in https://github.com/vllm-project/vllm/pull/24928
* [ROCm] Add dependencies for ROCm by @Concurrensee in https://github.com/vllm-project/vllm/pull/24900
* [gpt-oss][1][bugfix] fix streaming final output by @qandrew in https://github.com/vllm-project/vllm/pull/24466
* Use kwargs for long lists of `EngineCoreRequest` arguments in tests and fix extra kwargs by @qthequartermasterman in https://github.com/vllm-project/vllm/pull/24987
* fp8 kv cache support fix for torch.compile by @maleksan85 in https://github.com/vllm-project/vllm/pull/22758
* [Perf] Reuse workspace for FP8+FP4 Marlin MoE by @mgoin in https://github.com/vllm-project/vllm/pull/20500
* [CI][Bugfix] Fix failing Blackwell test by @MatthewBonanni in https://github.com/vllm-project/vllm/pull/24993
* [CI] GPT-OSS GPQA eval test for Blackwell by @mgoin in https://github.com/vllm-project/vllm/pull/24920
* [FP8] Extend per-token-group quantization support to QuantFP8 by @tahsintunan in https://github.com/vllm-project/vllm/pull/24342
* Removes source compilation of nixl dependency by @bbartels in https://github.com/vllm-project/vllm/pull/24874
* [Doc] Add --force-overwrite option to generate_cmake_presets.py by @elvischenv in https://github.com/vllm-project/vllm/pull/24375
* [Core] Use `CpuGpuBuffer` for block table tensors by @njhill in https://github.com/vllm-project/vllm/pull/24795
* [Benchmarks] Add MMVU video dataset support and clean up deprecated datasets by @Isotr0py in https://github.com/vllm-project/vllm/pull/24719
* [UX] Enforce valid choices for envs like VLLM_ATTENTION_BACKEND, etc by @mgoin in https://github.com/vllm-project/vllm/pull/24761
* [Docs] fix invalid doc link by @yyzxw in https://github.com/vllm-project/vllm/pull/25017
* [UX] Remove "quantization is not fully optimized yet" log by @mgoin in https://github.com/vllm-project/vllm/pull/25012
* [misc] fix typo in value error by @prashantgupta24 in https://github.com/vllm-project/vllm/pull/24995
* [Core] Get num_encoder_tokens from scheduler config by @russellb in https://github.com/vllm-project/vllm/pull/24989
* [V0 Deprecation] Remove MQLLMEngine by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25019
* [Model] Support Qwen3-VL Model Series by @ywang96 in https://github.com/vllm-project/vllm/pull/24727
* [Rocm] [quantization] Fix quark ptpc moe and add test case by @haoyangli-amd in https://github.com/vllm-project/vllm/pull/24649
* Add more documentation and improve usability of lognormal dist (benchmark_serving_multi_turn) by @pliops-daniels in https://github.com/vllm-project/vllm/pull/23255
* [XPU] Fix xpu model runner call torch.cuda APIs by @jikunshang in https://github.com/vllm-project/vllm/pull/25011
* [EPLB] Support EPLB for Mixtral Model by @rouchenzi in https://github.com/vllm-project/vllm/pull/22842
* [Core][MultiModalHasher] Hash images without converting image mode by @lgeiger in https://github.com/vllm-project/vllm/pull/24969
* [Model] Pass param prefix to LLMHead by @whx-sjtu in https://github.com/vllm-project/vllm/pull/24862
* [Model] Apply SharedFusedMoE to glm4_moe. by @whx-sjtu in https://github.com/vllm-project/vllm/pull/24849
* [Core] Remove tokenizer group in vLLM by @zhuohan123 in https://github.com/vllm-project/vllm/pull/24078
* [Docs] Fix griffe warning in base_static_graph.py by @windsonsea in https://github.com/vllm-project/vllm/pull/25018
* [DP] Create placement groups by ray_device_key by @xinyu-intel in https://github.com/vllm-project/vllm/pull/25026
* [Frontend] Support returning all prompt logprobs by @chaunceyjiang in https://github.com/vllm-project/vllm/pull/24956
* [BugFix] enable DOTALL to match multi-line tool_call parameters in extract_tool_call_required_streaming by @shijun-yin in https://github.com/vllm-project/vllm/pull/24668
* [Misc] Avoid use of deprecated `AutoModelForVision2Seq` by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25065
* Add RADIO Vision Encoder Support to vLLM by @danielafrimi in https://github.com/vllm-project/vllm/pull/24595
* [Bugfix] Fix Stream usage in CPU model runner and OneDNN kernel check by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/25046
* Apply fixes for CUDA 13 by @Aidyn-A in https://github.com/vllm-project/vllm/pull/24599
* [fix] lora benchmarks pass no_lora_flag_cpu by @dolpm in https://github.com/vllm-project/vllm/pull/23774
* [Bugfix][Qwen3-Next] fixes the varlen issue in qwen3-next's MTP implementation. by @sighingnow in https://github.com/vllm-project/vllm/pull/24957
* [Docs] improve code formatting and comments for eliminate griffe build warning. by @samzong in https://github.com/vllm-project/vllm/pull/25010
* Remove old cutlass mla by @MatthewBonanni in https://github.com/vllm-project/vllm/pull/23961
* [Docs] vllm/benchmarks/datasets.py fix docstring param format. by @samzong in https://github.com/vllm-project/vllm/pull/24970
* [CI Bugfix] Fix failing test_invalid_env by @mgoin in https://github.com/vllm-project/vllm/pull/25078
* [V0 Deprecation] Remove V0 Core tests by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25082
* cleanup: remove adapter commons  by @simon-mo in https://github.com/vllm-project/vllm/pull/25045
* Remove unused find_cuda_init helper script by @simon-mo in https://github.com/vllm-project/vllm/pull/25044
* [V0 Deprecation] Remove unused output processor util by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25023
* Change log level from info to debug for IOProcessor by @mgoin in https://github.com/vllm-project/vllm/pull/24999
* [CI] Revert back prepare_prompts and check_answers by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25087
* [V0 Deprecation] Remove V0 tests in test_sequence.py by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25088
* [CI Bugfix] Fix failing test_model_load_with_params tests due to tokenizer refactor by @mgoin in https://github.com/vllm-project/vllm/pull/25086
* [V1] Logits processor docs by @afeldman-nm in https://github.com/vllm-project/vllm/pull/22919
* [Misc] Update owners for KV connector and V1 offloading by @ApostaC in https://github.com/vllm-project/vllm/pull/25041
* [Bugfix] Update import path for bc_linter_include by @mmangkad in https://github.com/vllm-project/vllm/pull/24766
* [BUG] Exclude .pth files when pulling remote files  by @ahao-anyscale in https://github.com/vllm-project/vllm/pull/25092
* [Kernel] Faster pre-processing time for W4A8 by @czhu-cohere in https://github.com/vllm-project/vllm/pull/23972
* [gpt-oss][2] fix types for streaming by @qandrew in https://github.com/vllm-project/vllm/pull/24556
* [Bugfix][B200] Fix `cutlass_mla` hang by @alexm-redhat in https://github.com/vllm-project/vllm/pull/24966
* [ROCm][Bugfix] Aiter mha fp8 fix by @dllehr-amd in https://github.com/vllm-project/vllm/pull/24991
* Disable failing GPT-OSS Eval (Blackwell) for now by @mgoin in https://github.com/vllm-project/vllm/pull/25107
* [Bugfix] Refactor Flashinfer TRTLLM attention kernel selection logic by @elvischenv in https://github.com/vllm-project/vllm/pull/24600
* Add a batched auto tune script by @karan in https://github.com/vllm-project/vllm/pull/25076
* [Bugfix] Fix accuracy issue for silu_mul + nvfp4 quant fusion kernel by @elvischenv in https://github.com/vllm-project/vllm/pull/24833
* [Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses by @bnellnm in https://github.com/vllm-project/vllm/pull/22537
* [V0 Deprecation] Remove V0 Engine tests by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25114
* [V0 Deprecation] Remove V0 Tracing & Metrics tests by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25115
* [V0 Deprecation] Remove misc V0 tests by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25118
* [V0 Deprecation] Skip PP test by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25128
* [Kernels] Enable DeepGEMM by default by @bnellnm in https://github.com/vllm-project/vllm/pull/24462
* [MM Encoder] Apply DP ViT for Qwen3-VL model series by @ywang96 in https://github.com/vllm-project/vllm/pull/24955
* [Docs] Clean up the contributing README by @hmellor in https://github.com/vllm-project/vllm/pull/25099
* [Core][MM] Cleanup `MultiModalCache` by @lgeiger in https://github.com/vllm-project/vllm/pull/25006
* [Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in qwen2moe to successfully load ignored params in quantized models by @toncao in https://github.com/vllm-project/vllm/pull/24960
* [Kernels] Overlap shared experts with combine instead of dispatch by @bnellnm in https://github.com/vllm-project/vllm/pull/24254
* [Model] enable data parallel for InternVL vision encoder by @666even666 in https://github.com/vllm-project/vllm/pull/23909
* Mark prompt logprobs as incompatible with prompt embeds at API level by @qthequartermasterman in https://github.com/vllm-project/vllm/pull/25077
* [XPU] Whisper model support on XPU Platform by @chaojun-zhang in https://github.com/vllm-project/vllm/pull/25123
* [EPLB] Add EPLB support for hunyuan_v1 by @666even666 in https://github.com/vllm-project/vllm/pull/23078
* [V0 Deprecation] Remove more V0 tests by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25117
* [Spec Decode] Efficient padded speculation by @benchislett in https://github.com/vllm-project/vllm/pull/24539
* [benchmark] add peak throughput metrics and plot by @simon-mo in https://github.com/vllm-project/vllm/pull/23867
* [CLI] Use streaming in CLI chat and completion commands by @simon-mo in https://github.com/vllm-project/vllm/pull/23769
* [Kernel] Better inf handling for grouped topk cu by @lumina37 in https://github.com/vllm-project/vllm/pull/24886
* [Docs] Fix API Reference by @hmellor in https://github.com/vllm-project/vllm/pull/25140
* Retrieve `sliding_window` from text config in Gemma3 MM by @hmellor in https://github.com/vllm-project/vllm/pull/25085
* [Bugfix] when use s3 model cannot use default load_format by @lengrongfu in https://github.com/vllm-project/vllm/pull/24435
* [Qwen] Add fp8 checkpoint support for qwen3-next. by @sighingnow in https://github.com/vllm-project/vllm/pull/25079
* Add 'path' option to ImagePrompt data_format by @gfinol in https://github.com/vllm-project/vllm/pull/25081
* [Doc] Fix cross-reference warnings by @punitvara in https://github.com/vllm-project/vllm/pull/25058
* [Chore] Cleanup guided namespace, move to structured outputs config by @aarnphm in https://github.com/vllm-project/vllm/pull/22772
* Fix: Add explicit #include <omp.h> for OpenMP compatibility on certain toolchains  by @ihb2032 in https://github.com/vllm-project/vllm/pull/24951
* silu-v1: Fix EPS not being used during max-reduction by @elvircrn in https://github.com/vllm-project/vllm/pull/25069
* [Frontend] Support setting logprobs to -1 by @chaunceyjiang in https://github.com/vllm-project/vllm/pull/25031
* [Model] Improve Pooling Model by @jeejeelee in https://github.com/vllm-project/vllm/pull/25149
* Move `StructuredOutputsConfig` from `config/__init__.py` to `config/structured_outputs.py` by @hmellor in https://github.com/vllm-project/vllm/pull/25153
* [Docs] Fix pooling-params doc references in openai_compatible_server.md by @yankay in https://github.com/vllm-project/vllm/pull/24939
* [Docs] add the parallel sampling usage in LLMEngine and AsyncLLM by @gigit0000 in https://github.com/vllm-project/vllm/pull/24222
* Fix forward reference warning in documentation by @hmellor in https://github.com/vllm-project/vllm/pull/25150
* Fix `validate-config` pre-commit check by @hmellor in https://github.com/vllm-project/vllm/pull/25157
* [Bugfix][Mamba] - Fix Conv State Kernel FP32 Support by @Josephasafg in https://github.com/vllm-project/vllm/pull/24883
* [Misc] Clean up flags in `vllm bench serve` by @ywang96 in https://github.com/vllm-project/vllm/pull/25138
* [Structured Output][Refactor] Move `apply_grammar_bitmask()` method from `ModelRunner` to structured output utils by @shen-shanshan in https://github.com/vllm-project/vllm/pull/21999
* Refactor dense FP8 tensor/channel/block utils and add CT FP8 block by @mgoin in https://github.com/vllm-project/vllm/pull/21404
* [Misc] Add kv-connector label by @NickLucche in https://github.com/vllm-project/vllm/pull/25156
* [Kernel] Enable Hybrid Model Support in Triton Unified Attention Kernel by @jvlunteren in https://github.com/vllm-project/vllm/pull/21197
* [PERF] Add `conv1d` metadata to GDN attn by @vadiklyutiy in https://github.com/vllm-project/vllm/pull/25105
* feat(api): Return 503 on /health when engine is dead by @dongbo910220 in https://github.com/vllm-project/vllm/pull/24897
* [New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task by @noooop in https://github.com/vllm-project/vllm/pull/24872
* [Docs] Fix warnings in mkdocs build (continued) by @Zerohertz in https://github.com/vllm-project/vllm/pull/25163
* Enable Allgather/ReduceScatter backend for NaiveAllToAll by @wenscarl in https://github.com/vllm-project/vllm/pull/23964
* [Misc] Add codeowner for Transformers backend by @hmellor in https://github.com/vllm-project/vllm/pull/25180
* [spec decode] Fix MTP inference path for MiMo-7B model by @zixi-qi in https://github.com/vllm-project/vllm/pull/25136
* [ROCm][CI/Build] Use ROCm7.0 as the base by @gshtras in https://github.com/vllm-project/vllm/pull/25178
* [ROCm][AITER][Bugfix] Switch AITER to use PIECEWISE_AND_FULL compilation by @Rohan138 in https://github.com/vllm-project/vllm/pull/25104
* [KV offload][1/N] Introduce an offloading component by @orozery in https://github.com/vllm-project/vllm/pull/19848
* [V0 Deprecation] Remove AsyncLLMEngine by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25025
* [fix]: remove data type hardcoding from gptoss model implementation by @nikhil-arm in https://github.com/vllm-project/vllm/pull/23807
* [feat]: Create interface for model-specific M-RoPE by @AzizCode92 in https://github.com/vllm-project/vllm/pull/24194
* [Bug] Fix `returned_lse` not Defined issue by @yewentao256 in https://github.com/vllm-project/vllm/pull/25106
* [Bug] Fix torch Compilation Cache Hit Error by @yewentao256 in https://github.com/vllm-project/vllm/pull/25093
* [V0 Deprecation] Remove unused async_timeout.py by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25190
* [KV offload][1b/N] rename offloading to kv_offload by @orozery in https://github.com/vllm-project/vllm/pull/25191
* [BugFix] Fix DeepGEMM warmup, no m.weight_scale_inv by @LucasWilkinson in https://github.com/vllm-project/vllm/pull/25206
* [CORE] Prompt Embeddings Support for v1 Engine by @qthequartermasterman in https://github.com/vllm-project/vllm/pull/24278
* [KV offload][2/N] Introduce LRU-based CPU offloading management by @orozery in https://github.com/vllm-project/vllm/pull/20075
* [gpt-oss] Add ResponseReasoningPartAddedEvent, ResponseReasoningPartDoneEvent for streaming by @qandrew in https://github.com/vllm-project/vllm/pull/24938
* [Perf] Optimize memory peak during EAGLE model loading. by @candyzone in https://github.com/vllm-project/vllm/pull/24585
* [Misc] Clean up MM profiling warnings by @ywang96 in https://github.com/vllm-project/vllm/pull/25222
* [Docs] Fix griffe warnings in vllm/multimodal by @windsonsea in https://github.com/vllm-project/vllm/pull/25216
* [OOT] Support sync_model_loading for OOT by @xuechendi in https://github.com/vllm-project/vllm/pull/25126
* [Build] Update Xgrammar to 0.1.24 to get a CVE fix by @russellb in https://github.com/vllm-project/vllm/pull/25188
* [CPU] Disable oneDNN linear on non-x86 platforms by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/25166
* [Bugfix][CPU] Add placeholder to avoid import errors when using fused_moe ops on platforms without triton by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/25137
* [Misc] Cleanup test conftest for deprecated encoder-decoder models by @Isotr0py in https://github.com/vllm-project/vllm/pull/25231
* [bugfix] fix MHA for models like OpenGVLab/InternVL3_5-38B by @yma11 in https://github.com/vllm-project/vllm/pull/25146
* [Kernel][Performance] Add Triton kernel for Qwen3-VL interleaved MRoPE by @Isotr0py in https://github.com/vllm-project/vllm/pull/25055
* [Bugfix][Perf] Misc fixes for Qwen3 VL by @ywang96 in https://github.com/vllm-project/vllm/pull/25238
* Move `PoolerConfig` from `config/__init__.py` to `config/pooler.py` by @hmellor in https://github.com/vllm-project/vllm/pull/25181
* [P/D][Nixl] Introduce `KVTransferMetrics` and aggregation strategy by @NickLucche in https://github.com/vllm-project/vllm/pull/22188
* [V0 Deprecation] Remove V0 logic from `get_input_embeddings` interface by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25242
* [Qwen] Remove cuda hard-code in qwen3 next by @wxsIcey in https://github.com/vllm-project/vllm/pull/25243
* Update CODEOWNERS by @hmellor in https://github.com/vllm-project/vllm/pull/25269
* Move `ModelConfig` from `config/__init__.py` to `config/model.py` by @hmellor in https://github.com/vllm-project/vllm/pull/25252
* refactor(benchmarks): add type annotations to wait_for_endpoint parameters by @samzong in https://github.com/vllm-project/vllm/pull/25218
* [KV offload][3/N] Add worker-side CPU support by @orozery in https://github.com/vllm-project/vllm/pull/21448
* [Frontend] Pass API server count to each process by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/23717
* [Core] Modify the initialization parameters of the lora manager by @jeejeelee in https://github.com/vllm-project/vllm/pull/25249
* Remove Redundant Assignment in Qwen3_VisionPatchMerger by @LJH-LBJ in https://github.com/vllm-project/vllm/pull/25224
* Encoder model support for the Transformers backend by @hmellor in https://github.com/vllm-project/vllm/pull/25174
* [CI/Build] fix test function_calling by @chaunceyjiang in https://github.com/vllm-project/vllm/pull/25072
* [Core][Prefix Hash] Fix prefix hash metrics sliding window maintainance by @Jialin in https://github.com/vllm-project/vllm/pull/24990
* [Docs] add __init__.py to vllm/model_executor/layers/quantization/compressed_tensors/transform by @samzong in https://github.com/vllm-project/vllm/pull/24974
* [bugfix] fix structured outputs key missing issue from #24929 by @luccafong in https://github.com/vllm-project/vllm/pull/25195
* [KV offload][4/N] Offloading KV connector by @orozery in https://github.com/vllm-project/vllm/pull/22595
* Optimize triton unified attention performance for sliding window attention by @zixi-qi in https://github.com/vllm-project/vllm/pull/24390
* [Bugfix] GPT OSS Attritbute error on H100 by @varun-sundar-rabindranath in https://github.com/vllm-project/vllm/pull/25228
* [Bugfix] Fix chunked a2_scales in modular kernels by @bnellnm in https://github.com/vllm-project/vllm/pull/25264
* Specify platform in `pip-compile` `pre-commit` hook so it runs on MacOS by @hmellor in https://github.com/vllm-project/vllm/pull/25273
* [Perf] Use FlashInfer RoPE for RotaryEmbedding.forward_cuda when available by @mgoin in https://github.com/vllm-project/vllm/pull/21126
* [BugFix] Make FlashInferMetadataBuilder non-blocking by @nvjullin in https://github.com/vllm-project/vllm/pull/25040
* Fix: Correct FusedMoE layer reference in auto_round quantization by @David-Wen2025 in https://github.com/vllm-project/vllm/pull/24818
* [Frontend] Responses API messages out, just harmony for now by @alecsolder in https://github.com/vllm-project/vllm/pull/24985
* [Compile] Fix Compile Warning for Ignoring `MIN_BLOCK_PER_SM` by @yewentao256 in https://github.com/vllm-project/vllm/pull/25193
* Enable modelopt gemma3 nvfp4/fp8, make workflow more robust by @Edwardf0t1 in https://github.com/vllm-project/vllm/pull/22771
* allow disable flashinfer prefill by @luccafong in https://github.com/vllm-project/vllm/pull/25276
* [BugFix] Fix async scheduling CPU tensor race take 2 by @njhill in https://github.com/vllm-project/vllm/pull/25279
* [Bugfix] Remove VLLM_TEST_DYNAMO_FULLGRAPH_CAPTURE #2969 by @Lucaskabela in https://github.com/vllm-project/vllm/pull/25090
* Don't skip special tokens with hermes-style tool calling by @maxdebayser in https://github.com/vllm-project/vllm/pull/25281
* test: Remove vestigial skip for prompt embeds tests after landing v1 Prompt Embeds support by @qthequartermasterman in https://github.com/vllm-project/vllm/pull/25291
* [docs] Prompt Embedding feature support by @qthequartermasterman in https://github.com/vllm-project/vllm/pull/25288
* [torch.compile] CUDAGraph Inductor partition integration by @BoyuanFeng in https://github.com/vllm-project/vllm/pull/24281
* [BugFix] Ensure appropriate guards in destructors by @njhill in https://github.com/vllm-project/vllm/pull/25284
* [Misc] Support more collective_rpc return types by @njhill in https://github.com/vllm-project/vllm/pull/25294
* Improve weight loading for encoder models in Transformers backend by @hmellor in https://github.com/vllm-project/vllm/pull/25289
* [BUGFIX] GPTQ quantization compatibility for Qwen3 Next MOE models (AutoGPTQ and AutoRound-GPTQ) by @JartX in https://github.com/vllm-project/vllm/pull/25268
* [BugFix] Exclude self when checking for port collision by @njhill in https://github.com/vllm-project/vllm/pull/25286
* [BUG FIX][NON-CUDA]quick fix to avoid call cudagraph_unsafe in attention by @xuechendi in https://github.com/vllm-project/vllm/pull/25298
* [Bugfix] fix tool call arguments is empty by @chaunceyjiang in https://github.com/vllm-project/vllm/pull/25223
* [Optimization] Avoid repeated model architecture conversion for pooling models by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25261
* [Hybrid Allocator] Support full attention with different hidden size  by @heheda12345 in https://github.com/vllm-project/vllm/pull/25101
* [Bugfix] Fix Qwen3-VL-MoE weight loading for EP by @ywang96 in https://github.com/vllm-project/vllm/pull/25300
* [V1] Support `LLM.apply_model` by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/18465
* [CI Failure] Disable FlashInfer RoPE to unblock CI by @mgoin in https://github.com/vllm-project/vllm/pull/25299
* [Docs] Fix warnings in mkdocs build (continued)  by @wwl2755 in https://github.com/vllm-project/vllm/pull/25042
* Generate _ModelInfo properties file when loading to improve loading speed by @manoelmarques in https://github.com/vllm-project/vllm/pull/23558
* [Model] Cleanup InternViT's data parallel implementation  by @Isotr0py in https://github.com/vllm-project/vllm/pull/25306
* [Core] Enable sharded state loader for V1 engine and enhance test coverage by @lirong-lirong in https://github.com/vllm-project/vllm/pull/25308
* [V0 Deprecation] Enable the remaining multimodal tests in V1 by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25307
* [Docs] Fix warnings in vllm/profiler and vllm/transformers_utils by @windsonsea in https://github.com/vllm-project/vllm/pull/25220
* [V0 Deprecation] Remove LLMEngine by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25033
* [V0 Deprecation] Remove V0 Output Processor by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25320
* [Chore] Remove unused sampler in models by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25324
* [CI] Skip tests failing on main by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25326
* [V0 Deprecation] Remove V0 core by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25321
* [Doc] improve test-pipeline.yaml documentation by @hl475 in https://github.com/vllm-project/vllm/pull/25305
* [V0 Deprecation] Remove V0 model runner base & simplify worker base by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25328
* [Multi Modal][Performance] Fused Q,K's apply_rope in more models by @wwl2755 in https://github.com/vllm-project/vllm/pull/25005
* [V0 Deprecation] Remove from_seq_group methods by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25330
* [V0 Deprecation] Remove V0 MP executor by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25329
* [V1] Add sliding window support to Flex Attention backend by @Isotr0py in https://github.com/vllm-project/vllm/pull/24089
* [MM][Perf] Minor Optimization on Qwen3-VL `fast_pos_embed_interpolate` by @ywang96 in https://github.com/vllm-project/vllm/pull/25337
* [Bugfix] Typos in error message for missing model config file by @simondanielsson in https://github.com/vllm-project/vllm/pull/25339
* [Optimization] Cache chat template result when processor fails to be loaded by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25341
* [V0 Deprecation] Remove V0 Sequence class & Sampler by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25332
* [V0 Deprecation] Remove async_output_proc, preemption mode, delay factor by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25334
* feat: Enable engine-level arguments with speculators models by @rahul-tuli in https://github.com/vllm-project/vllm/pull/25250
* [V0 Deprecation] Remove V0 sampling metadata by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25345
* [Perf] Further optimization for Qwen3-VL `fast_pos_embed_interpolate` by @Isotr0py in https://github.com/vllm-project/vllm/pull/25347
* Remove V0 attention backends by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25351
* [Bugfix][V0 Deprecation][CI] use async mock and await for async method by @KKSK-DON in https://github.com/vllm-project/vllm/pull/25325
* Multimodal - audio tests by @debroy-rh in https://github.com/vllm-project/vllm/pull/25285
* [Model] Support Dots OCR by @ywang96 in https://github.com/vllm-project/vllm/pull/24645
* [Docs] GSM8K Accuracy Evaluation doc update by @david6666666 in https://github.com/vllm-project/vllm/pull/25360
* [Bugfix] Fix hermes tool parser handling of non-string argument types by @david6666666 in https://github.com/vllm-project/vllm/pull/22002
* [V0 Deprecation] Remove V0-only methods in multi-modal registry by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25362
* [V0 Deprecation] Remove `MultiModalPlaceholderMap` by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25366
* Enable Eagle3 speculative decoding for GPT-OSS model by @eldarkurtic in https://github.com/vllm-project/vllm/pull/25246
* [TPU][Bugfix][CI] Fix broken tests/build dependency by @NickLucche in https://github.com/vllm-project/vllm/pull/25255
* [TPU] Deprecate `xm.mark_step` in favor of ``torch_xla.sync`  by @NickLucche in https://github.com/vllm-project/vllm/pull/25254
* refactor: abstract graph mode support into platform interface by @yiz-liu in https://github.com/vllm-project/vllm/pull/25161
* [Misc] Remove unused encoder-decoder error strings by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25374
* Make pickle import check fast by @hmellor in https://github.com/vllm-project/vllm/pull/25379
* Make `mypy` behave like a proper pre-commit hook by @hmellor in https://github.com/vllm-project/vllm/pull/25313
* MI-300X triton moe configs by @Sara-KS in https://github.com/vllm-project/vllm/pull/23445
* [Bugfix] Fix several issues with p2p xPyD in GET type by @Csrayz in https://github.com/vllm-project/vllm/pull/23993
* [V1][Attention] Split triton_attn in triton-only and rocm specific backends  by @bringlein in https://github.com/vllm-project/vllm/pull/24648
* [EPLB] Reduce EPLB Inference Overhead by @abmfy in https://github.com/vllm-project/vllm/pull/24573
* [CLI env var] Add VLLM_FLASH_ATTN_MAX_NUM_SPLITS_FOR_CUDA_GRAPH in env variables by @Daisy-Ma-coder in https://github.com/vllm-project/vllm/pull/25274
* [Compiler] Disable Inductor standalone compile by default by @ElizaWszola in https://github.com/vllm-project/vllm/pull/25391
* [CI Failure] Fix fp8 kv cache on <SM90 by @mgoin in https://github.com/vllm-project/vllm/pull/25396
* [DP] support torchrun external launcher with Data Parallelism by @luccafong in https://github.com/vllm-project/vllm/pull/24899
* Remove RFC review hours reference by @simon-mo in https://github.com/vllm-project/vllm/pull/25416
* [torch.compile] Cleanup compilation tests and custom passes, add debug utils, fix DCE bug (#23091), fix test (#24376), and prep for custom op matching (#24604) by @ProExpertProg in https://github.com/vllm-project/vllm/pull/24542
* [KV offload][5/N] Add `CPUOffloadingSpec` by @orozery in https://github.com/vllm-project/vllm/pull/24251
* [CI/Build] Skip Qwen3-VL initialization tests until models are actually released by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25394
* [TPU] update torch_xla dependency for PyPI compatibility by @jcyang43 in https://github.com/vllm-project/vllm/pull/25278
* [Frontend] Responses API MCP tools for built in tools and to pass through headers by @alecsolder in https://github.com/vllm-project/vllm/pull/24628
* [Bugfix] fix custom op test by @ProExpertProg in https://github.com/vllm-project/vllm/pull/25429
* [Core] Drop overly aggressive whisper assertion by @russellb in https://github.com/vllm-project/vllm/pull/25408
* [Bugfix] Fix missing `clear_connector_metadata` by @NickLucche in https://github.com/vllm-project/vllm/pull/25397
* [BugFix] [DP/EP] Fix slow execution when BS <= DP by @MatthewBonanni in https://github.com/vllm-project/vllm/pull/25407
* [Performance] Remove input pads in cutlass_mla and optimize v_proj output handling by @alexm-redhat in https://github.com/vllm-project/vllm/pull/25184
* [Perf] Apply torch.compile for `per_block_cast_to_fp8` by @yewentao256 in https://github.com/vllm-project/vllm/pull/24611
* [V0 deprecation] Remove platform v1 controling interface by @Isotr0py in https://github.com/vllm-project/vllm/pull/25410
* [V0 deprecation] Remove `_set_default_args_v0` function by @Isotr0py in https://github.com/vllm-project/vllm/pull/25409
* [Bug] Fix Long Context OOM Issue by @yewentao256 in https://github.com/vllm-project/vllm/pull/25290
* [feat] Support MRoPE +  YaRN by @JJJYmmm in https://github.com/vllm-project/vllm/pull/25384
* [XPU] Fix `compile_size` is `None` case. by @jikunshang in https://github.com/vllm-project/vllm/pull/25433
* [benchmarks]allow skip ready check for bench serve by @luccafong in https://github.com/vllm-project/vllm/pull/25420
* [Bugfix] Remove contiguous output req for context parallel MLA by @mgoin in https://github.com/vllm-project/vllm/pull/25414
* [Docs] Fix griffe warnings in vllm/lora/ops by @windsonsea in https://github.com/vllm-project/vllm/pull/25369
* [DP/EP][GPTOSS] Use triton matmul-ogs kernels for GPTOSS DP/EP by @varun-sundar-rabindranath in https://github.com/vllm-project/vllm/pull/24588
* [NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend by @xuechendi in https://github.com/vllm-project/vllm/pull/25121
* [Model] Enable DP for ViT in Qwen2-VL by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25445
* Handle triton kernel import exception by @minosfuture in https://github.com/vllm-project/vllm/pull/25319
* [Frontend] Add a new xml-based tool parser for qwen3-coder by @Zhikaiiii in https://github.com/vllm-project/vllm/pull/25028
* [Misc] Move DP for ViT code inside model executor dir by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25459
* [Test]: Hermes tool parser stream output error in Qwen3 case by @ahartel in https://github.com/vllm-project/vllm/pull/25203
* [Bugfix] Fix idefics3 `tie_word_embeddings` by @Isotr0py in https://github.com/vllm-project/vllm/pull/25454
* [Core] Optimize LoRA weight loading by @jeejeelee in https://github.com/vllm-project/vllm/pull/25403
* [docs] Benchmark Serving Incorrect Arg by @vllmellm in https://github.com/vllm-project/vllm/pull/25474
* [CI/Build] Fix disabled v1 attention backend selection test by @Isotr0py in https://github.com/vllm-project/vllm/pull/25471
* [BugFix] Register expert_map as named buffer for wake_up and sleep by @wuxibin89 in https://github.com/vllm-project/vllm/pull/25458
* [P/D] Support NIXL connector to disconnect during a clean shutdown by @chaunceyjiang in https://github.com/vllm-project/vllm/pull/24423
* [test/doc] make NixlConnector example more clear by @panpan0000 in https://github.com/vllm-project/vllm/pull/24249
* [XPU] Fix MOE DP accuracy issue on XPU by @faaany in https://github.com/vllm-project/vllm/pull/25465
* [UX] Change kv-cache-memory log level to debug by @mgoin in https://github.com/vllm-project/vllm/pull/25479
* [V1] Remove V0 code paths for Hybrid models by @tdoublep in https://github.com/vllm-project/vllm/pull/25400
* [Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support by @LucasWilkinson in https://github.com/vllm-project/vllm/pull/24845
* Add backward compatibility for `GuidedDecodingParams` by @hmellor in https://github.com/vllm-project/vllm/pull/25422
* [Kernels] Support blocked fp8 quantization for compressed tensors MoE by @bnellnm in https://github.com/vllm-project/vllm/pull/25219
* [BugFix] Fix UB in per_token_group_quant.cu by @rivos-shreeasish in https://github.com/vllm-project/vllm/pull/24913
* [Log] Optimize kv cache memory log from Bytes to GiB by @yewentao256 in https://github.com/vllm-project/vllm/pull/25204
* Use macro guard CUDA functions for back compatibility in grouped_topk_kernel.cu by @minosfuture in https://github.com/vllm-project/vllm/pull/25346
* [V1][Kernel] Add triton implementation for `reshape_and_cache_flash` by @bringlein in https://github.com/vllm-project/vllm/pull/24503
* [Misc] Reduce initialization time of auto_tune by @wdhongtw in https://github.com/vllm-project/vllm/pull/23682
* [Spec Decode][CI] Add e2e test for `examples/spec_decode.py` and prevent breaking Acceptance Length by @ekagra-ranjan in https://github.com/vllm-project/vllm/pull/24531
* [Core] Ensure LoRA linear respect the base_layer's tp_size and tp_rank by @jeejeelee in https://github.com/vllm-project/vllm/pull/25487
* [ROCm] Add skinny gemm bias support for dtypes fp16,bf16,fp8 by @amd-hhashemi in https://github.com/vllm-project/vllm/pull/24988
* [core] add nccl symmetric memory for all reduce by @Amir-19 in https://github.com/vllm-project/vllm/pull/24532
* [Performance] Move apply_w8a8_block_fp8_linear to an op class by @ElizaWszola in https://github.com/vllm-project/vllm/pull/24666
* [Perf] Change default CUDAGraphMode from PIECEWISE to FULL_AND_PIECEWISE by @mgoin in https://github.com/vllm-project/vllm/pull/25444
* [Speculators][Speculative Decoding] Fix gpt-oss eagle3 accuracy issue by @jiahanc in https://github.com/vllm-project/vllm/pull/25406
* [Bugfix] Lower gpt-oss max cudagraph size to 992 to be compatible with FA3 by @mgoin in https://github.com/vllm-project/vllm/pull/25508
* Enable symmetric memory all reduce by default only enabling for TP by @ilmarkov in https://github.com/vllm-project/vllm/pull/25070
* [CI] Fix Pre-commit Issue by @yewentao256 in https://github.com/vllm-project/vllm/pull/25497
* [Bugfix] gpt-oss container tool output bug by @alecsolder in https://github.com/vllm-project/vllm/pull/25485
* [Build] Update Xgrammar to 0.1.25 by @chaunceyjiang in https://github.com/vllm-project/vllm/pull/25467
* [Bugfix] Fix for the import error from #24588 by @gshtras in https://github.com/vllm-project/vllm/pull/25481
* [CI/Build] Fix and re-enable v1 PP test on CI by @Isotr0py in https://github.com/vllm-project/vllm/pull/25496
* [Core] Use KVCacheBlock as much as possible instead of dict[block_id, KVCacheBlock] by @Jialin in https://github.com/vllm-project/vllm/pull/24830
* [V0 Deprecation] Remove placeholder attn by @tdoublep in https://github.com/vllm-project/vllm/pull/25510
* Add VLLM_ENABLE_INDUCTOR_MAX_AUTOTUNE & VLLM_ENABLE_INDUCTOR_COORDINA… by @rouchenzi in https://github.com/vllm-project/vllm/pull/25493
* Fix triton_reshape_and_cache_flash.py triton import by @mgoin in https://github.com/vllm-project/vllm/pull/25522
* [gpt-oss][bugfix] remove logic to require resp_ in ResponseAPI by @qandrew in https://github.com/vllm-project/vllm/pull/25428
* Remove redundant mutates_args and dispatch_key for direct_register_custom_op by @mgoin in https://github.com/vllm-project/vllm/pull/25512
* [BugFix] Fix OOM in vLLM replicas by ensuring consistent NCCL memory accounting by @kouroshHakha in https://github.com/vllm-project/vllm/pull/25359
* Add `VLLM_NVTX_SCOPES_FOR_PROFILING=1` to enable `nvtx.annotate` scopes by @coreylowman in https://github.com/vllm-project/vllm/pull/25501
* [Kernel] [Mamba] Remove BLOCK_H=1 from list of tuneable configurations for `_chunk_cumsum_fwd_kernel` by @tdoublep in https://github.com/vllm-project/vllm/pull/25197
* [ROCm] Small functional changes for gptoss by @jpvillam-amd in https://github.com/vllm-project/vllm/pull/25201
* [Perf] Increase default max splits for FA3 full cudagraphs by @LucasWilkinson in https://github.com/vllm-project/vllm/pull/25495
* [Bugfix] [B200] cutlass_mla - ensure kv_split == 1 for batch size > 1 by @alexm-redhat in https://github.com/vllm-project/vllm/pull/25509
* [BugFix] AssertionError: Do not capture num_reqs > max_num_reqs for uniform batch by @LucasWilkinson in https://github.com/vllm-project/vllm/pull/25505
* Improve output when failing json.loads() on structured output test by @dougbtv in https://github.com/vllm-project/vllm/pull/25483
* Add CUTLASS FP8 MOE benchmark scripts and kernel config by @chenxi-yang in https://github.com/vllm-project/vllm/pull/25302
* [Bug] Fix AttributeError: 'FusedMoE' object has no attribute 'w13_weight_scale'. Did you mean: 'w13_weight_scale_inv' by @yewentao256 in https://github.com/vllm-project/vllm/pull/25519
* [BUG] Allows for RunAI Streamer and Torch.compile cache to be used together by @ahao-anyscale in https://github.com/vllm-project/vllm/pull/24922
* [Model] Support SeedOss Reason Parser by @LuYanFCP in https://github.com/vllm-project/vllm/pull/24263
* [V1][Metrics] Add per-request TPOT histogram by @baxingpiaochong in https://github.com/vllm-project/vllm/pull/24015
* [Bugfix] Use a separate FlashInfer workspace buffer for trtllm-gen by @benchislett in https://github.com/vllm-project/vllm/pull/25520
* [Core] Support weight_loader_v2 for `UnquantizedLinearMethod` by @kylesayrs in https://github.com/vllm-project/vllm/pull/23036
* [Compile] Fix AMD Compile Error by @yewentao256 in https://github.com/vllm-project/vllm/pull/25518
* [BugFix] Fix MLA assert with CUTLASS MLA by @LucasWilkinson in https://github.com/vllm-project/vllm/pull/25478
* [fix]: add Arm 4bit fused moe support by @nikhil-arm in https://github.com/vllm-project/vllm/pull/23809
* [KV sharing] Re-land Gemma3n model changes from #22628 by @sarckk in https://github.com/vllm-project/vllm/pull/24357
* [Spec Decode] Enable FlashInfer Spec Decoding by @benchislett in https://github.com/vllm-project/vllm/pull/25196
* [Perf] Fix jit compiles at runtime of fla gated delta rule by @coreylowman in https://github.com/vllm-project/vllm/pull/25432
* [Bugfix] [Frontend] Cleanup gpt-oss non-streaming chat tool calls by @bbrowning in https://github.com/vllm-project/vllm/pull/25514
* [TPU][Bugfix] fix the missing apply_model in tpu worker by @yaochengji in https://github.com/vllm-project/vllm/pull/25526
* [Misc] Retry HF processing if "Already borrowed" error occurs by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25535
* [Bugfix][CPU] Skip unsupported custom op register on CPU by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/25534
* [CI/Build] Fix v1 OOT registration test by @Isotr0py in https://github.com/vllm-project/vllm/pull/25547
* [Misc]] Move processing context to multimodal directory by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25548
* [CI/Build] add nightly prime-rl integration tests by @Jackmin801 in https://github.com/vllm-project/vllm/pull/25207
* [V0 Deprecation] Remove max_seq_len_to_capture by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25543
* [BugFix] Potential Fix for FA3 full-cudagraph IMA  by @LucasWilkinson in https://github.com/vllm-project/vllm/pull/25490
* [misc] update the warning message by @youkaichao in https://github.com/vllm-project/vllm/pull/25566
* [Bugfix] Fix dummy video number of frames calculation by @ywang96 in https://github.com/vllm-project/vllm/pull/25553
* [Bug] fix import and unit test by @jmkuebler in https://github.com/vllm-project/vllm/pull/25558
* [Benchmark] Fix regression in structured output benchmark by @russellb in https://github.com/vllm-project/vllm/pull/25500
* [docs] fix nixl kv_connector_extra_config.backends key by @panpan0000 in https://github.com/vllm-project/vllm/pull/25565
* [Bugfix] Fix DeepSeekV31ToolParser to correctly parse multiple tools in non-streaming output by @taohui in https://github.com/vllm-project/vllm/pull/25405
* Move `DeviceConfig`, `ObservabilityConfig`, `SpeechToTextConfig` to their own files by @hmellor in https://github.com/vllm-project/vllm/pull/25564
* [Misc] Improve type annotations for jsontree by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25577
* [ROCm][Bugfix] Only enable +rms_norm based on aiter if not explicitly disabled by @gshtras in https://github.com/vllm-project/vllm/pull/25275
* [ROCm][Build][Bugfix] Fix ROCm base docker whls installation order by @gshtras in https://github.com/vllm-project/vllm/pull/25415
* Fixes and updates to bench_per_token_quant_fp8 by @mgoin in https://github.com/vllm-project/vllm/pull/25591
* [Bugfix] add cache model when from object storage get model by @lengrongfu in https://github.com/vllm-project/vllm/pull/24764
* Support mnnvl all2allv from Flashinfer by @wenscarl in https://github.com/vllm-project/vllm/pull/21003
* Suppress benign cuBLAS warning when capturing cudagraphs with DBO by @SageMoore in https://github.com/vllm-project/vllm/pull/25596
* [Docs] Enable `fail_on_warning` for the docs build in CI by @hmellor in https://github.com/vllm-project/vllm/pull/25580
* [V0 Deprecation] Remove unused classes in attention by @WoosukKwon in https://github.com/vllm-project/vllm/pull/25541
* [Logging] Improve log for when DeepEP HT disables CUDA Graphs by @tlrmchlsmth in https://github.com/vllm-project/vllm/pull/25531
* feat: BF16 FlashInfer Fused Cutlass MOE for Hopper and Blackwell Expert Parallel by @djmmoss in https://github.com/vllm-project/vllm/pull/25503
* [Refactor] Use DeepGEMM Col Major TMA Aligned Tensor by @yewentao256 in https://github.com/vllm-project/vllm/pull/25517
* Improve `--help` for enhanced user experience by @hmellor in https://github.com/vllm-project/vllm/pull/24903
* [MISC] replace c10::optional with std::optional by @842974287 in https://github.com/vllm-project/vllm/pull/25602
* [Model] Improve DotsOCRForCausalLM by @jeejeelee in https://github.com/vllm-project/vllm/pull/25466
* [Kernel] Support DCP for Triton backend  by @frank-wei in https://github.com/vllm-project/vllm/pull/25132
* [Bug] Dynamo Unsupported due to `BasevLLMParameter.torch_function` calling disabled super() by @yewentao256 in https://github.com/vllm-project/vllm/pull/25613
* Enable Fbgemm NVFP4 on Dense models by @samanamp in https://github.com/vllm-project/vllm/pull/25609
* [Model] Add LongCat-Flash  by @OftenDream in https://github.com/vllm-project/vllm/pull/23991
* optimize: eliminate duplicate split_enc_dec_inputs calls by @nicole-lihui in https://github.com/vllm-project/vllm/pull/25573
* [Bugfix] fix apply_temperature to avoid nan in probs by @courage17340 in https://github.com/vllm-project/vllm/pull/24734
* [Misc] Simplify PoolerOutput and move to `v1/outputs` by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25629
* Map CwmForCausalLM to llama and LlamaForCausalLM by @jacobkahn in https://github.com/vllm-project/vllm/pull/25611
* typo: remove duplicate `is` by @nicole-lihui in https://github.com/vllm-project/vllm/pull/25641
* Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… by @tlrmchlsmth in https://github.com/vllm-project/vllm/pull/25607
* [fix] Update torch version in cpu-build.txt for AArch64/ppc64le and Darwin by @fadara01 in https://github.com/vllm-project/vllm/pull/25579
* [Misc] Fix Qwen3-VL `video_grid_thw` typing by @ywang96 in https://github.com/vllm-project/vllm/pull/25646
* [Bugfix] Add triton.language.tensor placeholder by @adobrzyn in https://github.com/vllm-project/vllm/pull/25649
* [Bugfix] Fix Qwen3-VL max_num_video_tokens calculation for video profiling by @Isotr0py in https://github.com/vllm-project/vllm/pull/25648
* [mypy] Further improve MM type annotations by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25654
* [Bugfix] Parse SpeculativeConfig Error by @yyzxw in https://github.com/vllm-project/vllm/pull/25142
* [V0 deprecation] Remove unreachable model_config.supported_tasks by @noooop in https://github.com/vllm-project/vllm/pull/25642
* Add backward compatibility for `guided_...` API by @hmellor in https://github.com/vllm-project/vllm/pull/25615
* [CI/Build] Fix flaky entrypoints test by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25663
* [XPU][Triton]add xpu config in triton_reshape_and_cache_flash by @jikunshang in https://github.com/vllm-project/vllm/pull/25643
* [Hardware][RISC-V] Add riscv64 support for vLLM with scalar by @langc23 in https://github.com/vllm-project/vllm/pull/22112
* [mypy] Fix wrong type annotations related to tuple by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25660
* [misc] warning by default for hanging / busy / idle by @youkaichao in https://github.com/vllm-project/vllm/pull/25627
* [torch.compile] Make Query Quantization Fusable by @jmkuebler in https://github.com/vllm-project/vllm/pull/24914
* [CPU] update torch 2.8 and fix missing fields in TorchSDPAMetadata by @bigPYJ1151 in https://github.com/vllm-project/vllm/pull/25652
* [ux] Switch a warning to debug about a pytorch fallback by @russellb in https://github.com/vllm-project/vllm/pull/23750
* [Bugfix] Fix InternS1 video processing after Transformers v4.56 by @Isotr0py in https://github.com/vllm-project/vllm/pull/25644
* [Misc] Remove cruft file in repo by @NickLucche in https://github.com/vllm-project/vllm/pull/25678
* [Logging] Remove TORCH_NCCL_AVOID_RECORD_STREAMS to squash a warning by @tlrmchlsmth in https://github.com/vllm-project/vllm/pull/25532
* [BUGFIX] Fix crash in Eagle Speculative Decoding models when exceedin… by @AlonKejzman in https://github.com/vllm-project/vllm/pull/24662
* Revert "[Bug] Dynamo Unsupported due to `BasevLLMParameter.torch_function` calling disabled super()" by @mgoin in https://github.com/vllm-project/vllm/pull/25681
* [BugFix] Fix DBO hang by @LucasWilkinson in https://github.com/vllm-project/vllm/pull/25625
* [Model] Add optional parameter to reasoning parser constructor by @taohui in https://github.com/vllm-project/vllm/pull/25554
* [Model] Define `merge_by_field_config` MM interface by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25676
* [V0 deprecation] Clean up V0 fallback in compilation config by @Isotr0py in https://github.com/vllm-project/vllm/pull/25675
* [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names by @MatthewBonanni in https://github.com/vllm-project/vllm/pull/25489
* [V0 deprecation] Clean up LoRA  by @jeejeelee in https://github.com/vllm-project/vllm/pull/25686
* [Misc] Simplify `test_argsort_mm_positions` by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25690
* [Optimization] Streamline `InputPreprocessor` by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25702
* [Optimization] Use a cheaper cache key in `get_model_architecture` by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25682
* [Spec Decode] Add Batch Parallel Ngram. Upto 8x lower overhead. by @ekagra-ranjan in https://github.com/vllm-project/vllm/pull/24986
* [Core] Enable command line logging for LLMEngine by @zhuohan123 in https://github.com/vllm-project/vllm/pull/25610
* [Model] rename NemotronH_Nano_VL -> NemotronH_Nano_VL_V2 by @tomeras91 in https://github.com/vllm-project/vllm/pull/25708
* Fix routing_bias dtype  by @wenscarl in https://github.com/vllm-project/vllm/pull/25711
* [Refactor] Remove DeepGEMM OP Register by @yewentao256 in https://github.com/vllm-project/vllm/pull/25710
* [Misc] Don't log shm dequeue delay warning on worker side by @njhill in https://github.com/vllm-project/vllm/pull/25720
* Llamas 3.1 405B fp4 changes upstreaming from 355_wip by @maleksan85 in https://github.com/vllm-project/vllm/pull/25135
* [Core] Force PIECEWISE CUDAGraph mode for encoder-decoder by @russellb in https://github.com/vllm-project/vllm/pull/25701
* [Misc] Remove unnecessary memoryviews in shm_broadcast.py by @njhill in https://github.com/vllm-project/vllm/pull/25721
* EVS Support (Video tokens pruning) by @BloodAxe in https://github.com/vllm-project/vllm/pull/22980
* [CI/Build] fix doc build warning: Failed to get 'name: description' pair by @yitingdc in https://github.com/vllm-project/vllm/pull/25733
* fix: revert cast to cpu in `MsgpackEncoder._encode_tensor` to avoid hidden performance regressions by @qthequartermasterman in https://github.com/vllm-project/vllm/pull/25738
* perf: Avoid copying inputs_embeds tensors to GPU unless prompt_embeds is enabled by @qthequartermasterman in https://github.com/vllm-project/vllm/pull/25739
* [Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI300X by @xaguilar-amd in https://github.com/vllm-project/vllm/pull/25703
* fix: print outputt offline_inference/base/chat.py example by @Iceber in https://github.com/vllm-project/vllm/pull/25744
* [Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride bug in causal_conv_1d. by @sighingnow in https://github.com/vllm-project/vllm/pull/25743
* Remove cuda hard-code in compute_causal_conv1d_metadata by @wxsIcey in https://github.com/vllm-project/vllm/pull/25555
* [misc] refactor speculative config by @yyzxw in https://github.com/vllm-project/vllm/pull/25657
* [Bugfix] Fix Shared Expert/Zero expert code in FusedMoE.process_chunk by @SageMoore in https://github.com/vllm-project/vllm/pull/25698
* Support LongCat-Flash-Chat tool call by @Xu-Wenqing in https://github.com/vllm-project/vllm/pull/24083
* [Doc] Update Batch-level DP docs by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25757
* [Model] Mamba2 varlen and metadata refactor  by @cyang49 in https://github.com/vllm-project/vllm/pull/21467
* [CI] Fix test_shared_storage_connector_hashes by @chaunceyjiang in https://github.com/vllm-project/vllm/pull/25748
* [Bugfix] Properly abort pooling request. by @noooop in https://github.com/vllm-project/vllm/pull/25734
* [CI/Build] Split up Distributed Tests by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25572
* [CI/Build] Fix some V1 tests not being run by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/25569
* [Quantization] Add field to skip unquantized modules for GPTQ config by @Isotr0py in https://github.com/vllm-project/vllm/pull/25455
* [BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring `dbo_prefill_token_threshold`) by @LucasWilkinson in https://github.com/vllm-project/vllm/pull/25622
* [ray][metrics] Replace ':' with '_' for OpenTelemetry compatibility in Ray by @eicherseiji in https://github.com/vllm-project/vllm/pull/25439
* [Fix][torch.compile] fix unique_filepath by @ZJY0516 in https://github.com/vllm-project/vllm/pull/25732
* Eagle3 that supports the Minicpm3 model by @LDLINGLINGLING in https://github.com/vllm-project/vllm/pull/24243
* [Doc]: improve CPU(x86) build-wheel-from-source section by @brokedba in https://github.com/vllm-project/vllm/pull/25617

## New Contributors
* @SamitHuang made their first contribution in https://github.com/vllm-project/vllm/pull/24733
* @rozeappletree made their first contribution in https://github.com/vllm-project/vllm/pull/24785
* @ChenTaoyu-SJTU made their first contribution in https://github.com/vllm-project/vllm/pull/24732
* @ziliangpeng made their first contribution in https://github.com/vllm-project/vllm/pull/24793
* @chenfengjin made their first contribution in https://github.com/vllm-project/vllm/pull/24823
* @LCAIZJ made their first contribution in https://github.com/vllm-project/vllm/pull/23917
* @xiao-llm made their first contribution in https://github.com/vllm-project/vllm/pull/22222
* @koiker made their first contribution in https://github.com/vllm-project/vllm/pull/20321
* @cboss6 made their first contribution in https://github.com/vllm-project/vllm/pull/23745
* @liangwen12year made their first contribution in https://github.com/vllm-project/vllm/pull/23498
* @lianyiibo made their first contribution in https://github.com/vllm-project/vllm/pull/24571
* @tahsintunan made their first contribution in https://github.com/vllm-project/vllm/pull/24342
* @haoyangli-amd made their first contribution in https://github.com/vllm-project/vllm/pull/24649
* @rouchenzi made their first contribution in https://github.com/vllm-project/vllm/pull/22842
* @xinyu-intel made their first contribution in https://github.com/vllm-project/vllm/pull/25026
* @shijun-yin made their first contribution in https://github.com/vllm-project/vllm/pull/24668
* @Aidyn-A made their first contribution in https://github.com/vllm-project/vllm/pull/24599
* @dolpm made their first contribution in https://github.com/vllm-project/vllm/pull/23774
* @samzong made their first contribution in https://github.com/vllm-project/vllm/pull/25010
* @mmangkad made their first contribution in https://github.com/vllm-project/vllm/pull/24766
* @karan made their first contribution in https://github.com/vllm-project/vllm/pull/25076
* @toncao made their first contribution in https://github.com/vllm-project/vllm/pull/24960
* @666even666 made their first contribution in https://github.com/vllm-project/vllm/pull/23909
* @lumina37 made their first contribution in https://github.com/vllm-project/vllm/pull/24886
* @gfinol made their first contribution in https://github.com/vllm-project/vllm/pull/25081
* @punitvara made their first contribution in https://github.com/vllm-project/vllm/pull/25058
* @gigit0000 made their first contribution in https://github.com/vllm-project/vllm/pull/24222
* @Rohan138 made their first contribution in https://github.com/vllm-project/vllm/pull/25104
* @candyzone made their first contribution in https://github.com/vllm-project/vllm/pull/24585
* @wxsIcey made their first contribution in https://github.com/vllm-project/vllm/pull/25243
* @LJH-LBJ made their first contribution in https://github.com/vllm-project/vllm/pull/25224
* @David-Wen2025 made their first contribution in https://github.com/vllm-project/vllm/pull/24818
* @alecsolder made their first contribution in https://github.com/vllm-project/vllm/pull/24985
* @Lucaskabela made their first contribution in https://github.com/vllm-project/vllm/pull/25090
* @manoelmarques made their first contribution in https://github.com/vllm-project/vllm/pull/23558
* @lirong-lirong made their first contribution in https://github.com/vllm-project/vllm/pull/25308
* @debroy-rh made their first contribution in https://github.com/vllm-project/vllm/pull/25285
* @Sara-KS made their first contribution in https://github.com/vllm-project/vllm/pull/23445
* @Daisy-Ma-coder made their first contribution in https://github.com/vllm-project/vllm/pull/25274
* @jcyang43 made their first contribution in https://github.com/vllm-project/vllm/pull/25278
* @Zhikaiiii made their first contribution in https://github.com/vllm-project/vllm/pull/25028
* @ahartel made their first contribution in https://github.com/vllm-project/vllm/pull/25203
* @wuxibin89 made their first contribution in https://github.com/vllm-project/vllm/pull/25458
* @rivos-shreeasish made their first contribution in https://github.com/vllm-project/vllm/pull/24913
* @Amir-19 made their first contribution in https://github.com/vllm-project/vllm/pull/24532
* @LuYanFCP made their first contribution in https://github.com/vllm-project/vllm/pull/24263
* @baxingpiaochong made their first contribution in https://github.com/vllm-project/vllm/pull/24015
* @Jackmin801 made their first contribution in https://github.com/vllm-project/vllm/pull/25207
* @taohui made their first contribution in https://github.com/vllm-project/vllm/pull/25405
* @OftenDream made their first contribution in https://github.com/vllm-project/vllm/pull/23991
* @nicole-lihui made their first contribution in https://github.com/vllm-project/vllm/pull/25573
* @jacobkahn made their first contribution in https://github.com/vllm-project/vllm/pull/25611
* @fadara01 made their first contribution in https://github.com/vllm-project/vllm/pull/25579
* @langc23 made their first contribution in https://github.com/vllm-project/vllm/pull/22112
* @AlonKejzman made their first contribution in https://github.com/vllm-project/vllm/pull/24662
* @BloodAxe made their first contribution in https://github.com/vllm-project/vllm/pull/22980
* @yitingdc made their first contribution in https://github.com/vllm-project/vllm/pull/25733
* @xaguilar-amd made their first contribution in https://github.com/vllm-project/vllm/pull/25703
* @Iceber made their first contribution in https://github.com/vllm-project/vllm/pull/25744
* @LDLINGLINGLING made their first contribution in https://github.com/vllm-project/vllm/pull/24243
* @brokedba made their first contribution in https://github.com/vllm-project/vllm/pull/25617

**Full Changelog**: https://github.com/vllm-project/vllm/compare/v0.10.2...v0.11.0