v0.5.3.post1

vllm-project/vllmv0.5.3.post1Jul 23, 2024by github-actions[bot]

AI Summary

A bugfix release to correct a configuration incompatibility between vLLM and the published Meta Llama 3.1 weights.

Key Highlights

Fixed an configuration incompatibility between vLLM (which tested against pre-released version) and the published Meta Llama 3.1 weights

New Features

Fix RoPE error in Llama 3.1

Full Release Notes

## Highlights
* We fixed an configuration incompatibility between vLLM (which tested against pre-released version) and the published Meta Llama 3.1 weights (#6693)

## What's Changed
* [Docs] Announce llama3.1 support by @WoosukKwon in https://github.com/vllm-project/vllm/pull/6688
* [doc][distributed] fix doc argument order by @youkaichao in https://github.com/vllm-project/vllm/pull/6691
* [Bugfix] Fix a log error in chunked prefill by @WoosukKwon in https://github.com/vllm-project/vllm/pull/6694
* [BugFix] Fix RoPE error in Llama 3.1 by @WoosukKwon in https://github.com/vllm-project/vllm/pull/6693
* Bump version to 0.5.3.post1 by @simon-mo in https://github.com/vllm-project/vllm/pull/6696


**Full Changelog**: https://github.com/vllm-project/vllm/compare/v0.5.3...v0.5.3.post1