v0.1.6

vllm-project/vllmv0.1.6Sep 8, 2023by github-actions[bot]

AI Summary

An emergency release to revert a previous breaking API change that would have caused existing code using AsyncLLMServer to stop working.

Key Highlights

Emergency release to revert a breaking API change

Breaking Changes

Reverted a breaking API change for AsyncLLMServer

New Features

Faster startup of vLLM
Start background task in AsyncLLMEngine.generate

Full Release Notes

**Note:** This is an emergency release to revert a breaking API change that can make many existing codes using AsyncLLMServer not work.

## What's Changed
* faster startup of vLLM  by @ri938 in https://github.com/vllm-project/vllm/pull/982
* Start background task in `AsyncLLMEngine.generate` by @Yard1 in https://github.com/vllm-project/vllm/pull/988
* Bump up the version to v0.1.6 by @zhuohan123 in https://github.com/vllm-project/vllm/pull/989

## New Contributors
* @ri938 made their first contribution in https://github.com/vllm-project/vllm/pull/982

**Full Changelog**: https://github.com/vllm-project/vllm/compare/v0.1.5...v0.1.6