v0.10.3

xorbitsai/inferencev0.10.3Apr 24, 2024by XprobeBot

AI Summary

This release adds support for the Llama-3 family and the Belle-whisper-large-v3-zh audio model. It includes bug fixes for model launching and cache management.

Key Highlights

Support for Llama-3 family
Added Belle-whisper-large-v3-zh audio model
Cache clearing for embedding and rerank models
Bug fixes for PEFT and extra parameters

New Features

support llama-3 family
Add Belle-whisper-large-v3-zh

Full Release Notes

# What's new in 0.10.3 (2024-04-24)
These are the changes in inference v0.10.3.
## New features
* FEAT: support llama-3 family by @qinxuye in https://github.com/xorbitsai/inference/pull/1332
* FEAT: Add Belle-whisper-large-v3-zh by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1351
## Enhancements
* ENH: fix the max length of codeqwen-7B-chat by @mikeshi80 in https://github.com/xorbitsai/inference/pull/1354
* ENH: Clear cache for embedding and rerank by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1360
## Bug fixes
* BUG: Fix Launching embedding or reranking models from commandline fails due to PEFT  by @hainaweiben in https://github.com/xorbitsai/inference/pull/1343
* BUG: Fix extra parameters issue when auto-recovering models by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/1348
* BUG: Fix old rerank models use flag rerank issue by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1350
## Documentation
* DOC: Add new models to README by @qinxuye in https://github.com/xorbitsai/inference/pull/1346
* DOC: Update README, add FastGPT to integrations by @yangchuansheng in https://github.com/xorbitsai/inference/pull/1355

## New Contributors
* @yangchuansheng made their first contribution in https://github.com/xorbitsai/inference/pull/1355

**Full Changelog**: https://github.com/xorbitsai/inference/compare/v0.10.2.post1...v0.10.3