Starstruk Logo MarkStarstruk

v0.13.1

xorbitsai/inferencev0.13.1Jul 12, 2024by XprobeBot

AI Summary

This update adds support for Flexible Models and enhances the UI by allowing users to specify download hubs. It also updates ChatTTS and removes the `chatglm-cpp` dependency to fix issues with `llama-cpp-python`.

Key Highlights

  • Flexible Model support
  • UI improvements for download hub configuration
  • Updated ChatTTS version
  • Removal of `chatglm-cpp` dependency

New Features

  • Support choose download hub
  • Specify download hub (UI)
  • Add support for Flexible Model
  • Fix client import

Full Release Notes

# What's new in 0.13.1 (2024-07-12)
These are the changes in inference v0.13.1.
## New features
* FEAT: support choose download hub by @amumu96 in https://github.com/xorbitsai/inference/pull/1841
* FEAT: [UI] Specify download hub. by @yiboyasss in https://github.com/xorbitsai/inference/pull/1840
* FEAT: Add support for Flexible Model by @shellc in https://github.com/xorbitsai/inference/pull/1671
## Enhancements
* ENH: Update ChatTTS by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1776
* ENH:  Added the parameter 'worker_ip' to the 'register' model. by @hainaweiben in https://github.com/xorbitsai/inference/pull/1773
* REF: Remove `chatglm-cpp` and Fix latest `llama-cpp-python` issue by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/1844
## Bug fixes
* BUG: cache status missing for model id with quantization placeholder by @Zihann73 in https://github.com/xorbitsai/inference/pull/1849
## Documentation
* DOC: Define a custom Rerank model by @Weaxs in https://github.com/xorbitsai/inference/pull/1821
* DOC: update readme by @qinxuye in https://github.com/xorbitsai/inference/pull/1815
## Others
* FIX: [UI] Historical parameter echo bugs. by @yiboyasss in https://github.com/xorbitsai/inference/pull/1810
* FIX: [UI] Fix download_hub bugs. by @yiboyasss in https://github.com/xorbitsai/inference/pull/1846
* CHORE: Close issue when it is stale by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/1827
* CHORE: Update issue template by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/1833

## New Contributors
* @Weaxs made their first contribution in https://github.com/xorbitsai/inference/pull/1821
* @shellc made their first contribution in https://github.com/xorbitsai/inference/pull/1671

**Full Changelog**: https://github.com/xorbitsai/inference/compare/v0.13.0...v0.13.1