v0.6.1.post2

vllm-project/vllmv0.6.1.post2Sep 13, 2024by github-actions[bot]

AI Summary

A bugfix release focused on resolving an issue where token streaming combined with stop strings resulted in incorrect final output truncation.

Key Highlights

Important bugfix related to token streaming combined with stop string

New Features

Fix final output truncation with stop string + streaming

Full Release Notes

## Highlights
* This release contains an important bugfix related to token streaming combined with stop string (#8468) 

## What's Changed
* [CI/Build] Enable InternVL2 PP test only on single node by @Isotr0py in https://github.com/vllm-project/vllm/pull/8437
* [doc] recommend pip instead of conda by @youkaichao in https://github.com/vllm-project/vllm/pull/8446
* [Misc] Skip loading extra bias for Qwen2-VL GPTQ-Int8 by @jeejeelee in https://github.com/vllm-project/vllm/pull/8442
* [misc][ci] fix quant test by @youkaichao in https://github.com/vllm-project/vllm/pull/8449
* [Installation] Gate FastAPI version for Python 3.8 by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/8456
* [plugin][torch.compile] allow to add custom compile backend by @youkaichao in https://github.com/vllm-project/vllm/pull/8445
* [CI/Build] Reorganize models tests by @DarkLight1337 in https://github.com/vllm-project/vllm/pull/7820
* [Doc] Add oneDNN installation to CPU backend documentation by @Isotr0py in https://github.com/vllm-project/vllm/pull/8467
* [HotFix] Fix final output truncation with stop string + streaming by @njhill in https://github.com/vllm-project/vllm/pull/8468
* bump version to v0.6.1.post2 by @simon-mo in https://github.com/vllm-project/vllm/pull/8473

**Full Changelog**: https://github.com/vllm-project/vllm/compare/v0.6.1.post1...v0.6.1.post2