Starstruk Logo MarkStarstruk

v0.14.4

xorbitsai/inferencev0.14.4Aug 30, 2024by XprobeBot

AI Summary

Adds support for CogVideoX-5b, enhances padding for SD inpainting models, moves Matcha to third-party, and fixes various bugs related to model launching, health checks, and configuration keys.

Key Highlights

  • Support for CogVideoX-5b
  • Padding support for SD inpainting models
  • Matcha moved to third-party
  • Fix health check for image-to-text models

New Features

  • CogVideoX-5b support

Full Release Notes

# What's new in 0.14.4 (2024-08-30)
These are the changes in inference v0.14.4.
## New features
* FEAT: support CogVideoX-5b by @qinxuye in https://github.com/xorbitsai/inference/pull/2197
## Enhancements
* ENH: support padding for sd inpainting model by @wxiwnd in https://github.com/xorbitsai/inference/pull/2165
* ENH: Move matcha to third party by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2166
* ENH: Fix callback status when model die by @frostyplanet in https://github.com/xorbitsai/inference/pull/2172
* ENH: support cosyvoice-300m-instruct without instruction by @qinxuye in https://github.com/xorbitsai/inference/pull/2175
* ENH: Remove opencc and fast_whisper by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2179
* ENH: solve the problem of health check for image-to-text model by @luhairong11 in https://github.com/xorbitsai/inference/pull/2182
## Bug fixes
* BUG: docker compose failed due to empty entrypoint by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/2180
* BUG: 🐛 fix unable launch qwen2-embedding by @Zzzz1111 in https://github.com/xorbitsai/inference/pull/2185
* BUG: configuration key different by sglang's version by @lordk911 in https://github.com/xorbitsai/inference/pull/2188
* BUG: fix lora not load in transformers engine by @amumu96 in https://github.com/xorbitsai/inference/pull/2194
* BUG: fix register model list error by @amumu96 in https://github.com/xorbitsai/inference/pull/2189
* BUG: Fix list video model by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2190
* BUG: fix custom path test error by @amumu96 in https://github.com/xorbitsai/inference/pull/2200
## Others
* EHN: clean cache for VL models by @qinxuye in https://github.com/xorbitsai/inference/pull/2163
* CHORE: Clean test env by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2183

## New Contributors
* @luhairong11 made their first contribution in https://github.com/xorbitsai/inference/pull/2182
* @lordk911 made their first contribution in https://github.com/xorbitsai/inference/pull/2188

**Full Changelog**: https://github.com/xorbitsai/inference/compare/v0.14.3...v0.14.4