Starstruk Logo MarkStarstruk

v0.12.3

xorbitsai/inferencev0.12.3Jun 28, 2024by XprobeBot

AI Summary

This release adds SD3 support, Jina Rerank v2, and Tensorizer integration. It also introduces UI features like favorites and automatic configuration retrieval, along with cluster deletion functionality.

Key Highlights

  • SD3 support
  • Jina Rerank v2 support
  • Tensorizer integration
  • UI Favorites and auto-config features

New Features

  • Add favorite function
  • Add SD3 support
  • Add the function of automatically obtaining the last configuration information
  • Support jina-rerank-v2
  • tensorizer integration
  • Delete cluster

Full Release Notes

# What's new in 0.12.3 (2024-06-28)
These are the changes in inference v0.12.3.
## New features
* FEAT: [UI] Add favorite function. by @yiboyasss in https://github.com/xorbitsai/inference/pull/1714
* FEAT: add SD3 support by @qinxuye in https://github.com/xorbitsai/inference/pull/1723
* FEAT: [UI] Add the function of automatically obtaining the last configuration information. by @yiboyasss in https://github.com/xorbitsai/inference/pull/1730
* FEAT: support jina-rerank-v2 by @qinxuye in https://github.com/xorbitsai/inference/pull/1733
* FEAT: `tensorizer` integration by @Zihann73 in https://github.com/xorbitsai/inference/pull/1579
* FEAT: Delete cluster by @hainaweiben in https://github.com/xorbitsai/inference/pull/1719
## Enhancements
* ENH: Set the CSG Hub endpoint as an environment variable. by @hainaweiben in https://github.com/xorbitsai/inference/pull/1666
* BLD: pin `chatglm-cpp` version `v0.3.x` by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/1692
## Bug fixes
* BUG: [UI] Fix deleting prompt_style when Model Family is other. by @yiboyasss in https://github.com/xorbitsai/inference/pull/1707
* BUG: GGUF models cannot use GPU in docker by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/1710
* BUG: Fix tool call observation by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1648
* BUG: [UI]fix favorite bug. by @yiboyasss in https://github.com/xorbitsai/inference/pull/1728
* BUG: curl with stream returns unicode chars rather than chinese character by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/1732
* BUG: Cluster info can be accessed without authorization in the auth mode by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/1731
## Others
* CHORE: upgrade version fix security vulnerability by @rickywu in https://github.com/xorbitsai/inference/pull/1674

## New Contributors
* @Zihann73 made their first contribution in https://github.com/xorbitsai/inference/pull/1579
* @rickywu made their first contribution in https://github.com/xorbitsai/inference/pull/1674

**Full Changelog**: https://github.com/xorbitsai/inference/compare/v0.12.2...v0.12.3