Starstruk Logo MarkStarstruk

v1.2.1

xorbitsai/inferencev1.2.1Jan 24, 2025by XprobeBot

AI Summary

This release introduces MeloTTS support, DeepSeek-R1-Distill-Qwen, and Cline-style messages for all backends. It also includes enhancements for Whisper model config and CosyVoice2 SFT speakers.

Key Highlights

  • Support for MeloTTS.
  • Support for DeepSeek-R1-Distill-Qwen.
  • Cline-style messages support for all backend engines.
  • Improved Whisper model configuration.
  • CosyVoice2 support for SFT speakers.

New Features

  • Support MeloTTS
  • support deepseek-r1-distill-qwen

Full Release Notes

# What's new in 1.2.1 (2025-01-24)
These are the changes in inference v1.2.1.
## New features
* FEAT: Support MeloTTS by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2760
* FEAT: support deepseek-r1-distill-qwen by @qinxuye in https://github.com/xorbitsai/inference/pull/2781
## Enhancements
* ENH: add model config for Whisper by @fonsc in https://github.com/xorbitsai/inference/pull/2755
* ENH: support cline style messages for all backend engines by @liunux4odoo in https://github.com/xorbitsai/inference/pull/2763
* ENH: CosyVoice2 support SFT speakers by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2770
* ENH: Some improvements for Xavier by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/2777
## Bug fixes
* BUG: Compat with openai extra body by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2759
## Tests
* TST: compatible with mlx-vlm 0.1.11 by @qinxuye in https://github.com/xorbitsai/inference/pull/2769
## Documentation
* DOC: update new models in README and doc by @qinxuye in https://github.com/xorbitsai/inference/pull/2761
* DOC: using discord instead of slack & updating model to qwen2.5 in getting started doc by @qinxuye in https://github.com/xorbitsai/inference/pull/2775
## Others
* FIX: [UI] normalize language input to ensure consistent array format. by @yiboyasss in https://github.com/xorbitsai/inference/pull/2771

## New Contributors
* @fonsc made their first contribution in https://github.com/xorbitsai/inference/pull/2755

**Full Changelog**: https://github.com/xorbitsai/inference/compare/v1.2.0...v1.2.1