Starstruk Logo MarkStarstruk

v0.11.3

xorbitsai/inferencev0.11.3May 31, 2024by XprobeBot

AI Summary

Introduces support for Yi-1.5-chat-16k, CogVLM, and Telechat models. Enhancements include adding engine options to launch details and a real paths column in the UI.

Key Highlights

  • Support for Yi-1.5-chat-16k
  • Support for CogVLM and Telechat
  • Engine options in launch details
  • Real paths column in UI

New Features

  • Support Yi-1.5-chat-16k
  • Support XINFERENCE_DISABLE_METRICS env
  • Support new model CogVLM
  • Telechat model
  • Added engines options to model launch details
  • Add additional_option at vl gradio
  • Add real paths column

Full Release Notes

# What's new in 0.11.3 (2024-05-31)
These are the changes in inference v0.11.3.
## New features
* FEAT: support Yi-1.5-chat-16k by @qinxuye in https://github.com/xorbitsai/inference/pull/1544
* FEAT: Support XINFERENCE_DISABLE_METRICS env by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1547
* FEAT: Support new model CogVLM by @amumu96 in https://github.com/xorbitsai/inference/pull/1551
* FEAT: telechat model by @LIKEGAKKI in https://github.com/xorbitsai/inference/pull/1567
## Enhancements
* ENH: added engines options to model launch details by @qinxuye in https://github.com/xorbitsai/inference/pull/1546
* ENH: rm mini-internvl by @amumu96 in https://github.com/xorbitsai/inference/pull/1563
* ENH: add additional_option at vl gradio by @amumu96 in https://github.com/xorbitsai/inference/pull/1561
* ENH: add real paths column by @hainaweiben in https://github.com/xorbitsai/inference/pull/1555
## Bug fixes
* BUG: fix launch model error when use torch 2.3.0 by @amumu96 in https://github.com/xorbitsai/inference/pull/1543
* BUG: fix vl-model img path error by @amumu96 in https://github.com/xorbitsai/inference/pull/1559
* BUG: Fix validation errors when define a custom baichuan-chat LLM model by @buptzyf in https://github.com/xorbitsai/inference/pull/1557
## Documentation
* DOC: update readme and fix description about model engine by @qinxuye in https://github.com/xorbitsai/inference/pull/1566
## Others
* Correct ModelActor import path in worker & supervisor by @frostyplanet in https://github.com/xorbitsai/inference/pull/1550

## New Contributors
* @buptzyf made their first contribution in https://github.com/xorbitsai/inference/pull/1557
* @LIKEGAKKI made their first contribution in https://github.com/xorbitsai/inference/pull/1567

**Full Changelog**: https://github.com/xorbitsai/inference/compare/v0.11.2...v0.11.3