Starstruk Logo MarkStarstruk

v0.13.2

xorbitsai/inferencev0.13.2Jul 19, 2024by XprobeBot

AI Summary

This release introduces support for SD inpainting, CodeGeeX4, and InternLM2.5-chat models, along with streaming capabilities for ChatTTS. It also includes bug fixes for Chinese character encoding and stream errors in vLLM and sglang backends.

Key Highlights

  • Support for SD inpainting models
  • Support for CodeGeeX4 and InternLM2.5-chat
  • Stream ChatTTS functionality
  • Bug fixes for Chinese characters and stream errors

New Features

  • Support sd inpainting models
  • Stream ChatTTS
  • Support codegeex4
  • Support internlm2.5-chat & internlm2.5-chat-1m

Full Release Notes

# What's new in 0.13.2 (2024-07-19)
These are the changes in inference v0.13.2.
## New features
* FEAT: support sd inpainting models by @qinxuye in https://github.com/xorbitsai/inference/pull/1879
* FEAT: Stream ChatTTS by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1812
* FEAT: support codegeex4 by @qinxuye in https://github.com/xorbitsai/inference/pull/1888
* FEAT: support internlm2.5-chat & internlm2.5-chat-1m by @qinxuye in https://github.com/xorbitsai/inference/pull/1887
## Enhancements
* ENH: added gguf formats for gemma-2-it by @qinxuye in https://github.com/xorbitsai/inference/pull/1874
## Bug fixes
* BUG: Fix stream unicode issue for chinese characters when using vllm backend by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/1865
* BUG: sglang stream error while stream_option not set by @wxiwnd in https://github.com/xorbitsai/inference/pull/1901
* BUG: fix client import by @amumu96 in https://github.com/xorbitsai/inference/pull/1905


**Full Changelog**: https://github.com/xorbitsai/inference/compare/v0.13.1...v0.13.2