Starstruk Logo MarkStarstruk

v0.16.3

xorbitsai/inferencev0.16.3Nov 8, 2024by XprobeBot

AI Summary

This update focuses on new vision capabilities, specifically adding support for Llama 3.2-Vision models, along with bug fixes for ChatTTS compatibility and logging.

Key Highlights

  • Added support for Llama 3.2-Vision models.
  • Enhanced process display to show model names.
  • Fixed compatibility issues with ChatTTS 0.2.1.

New Features

  • Add support for Llama 3.2-Vision models
  • Display model name in process

Full Release Notes

# What's new in 0.16.3 (2024-11-08)
These are the changes in inference v0.16.3.
## New features
* feat: Add support for Llama 3.2-Vision models by @vikrantrathore in https://github.com/xorbitsai/inference/pull/2376
## Enhancements
* ENH: Display model name in process by @frostyplanet in https://github.com/xorbitsai/inference/pull/1891
* REF: Remove replica total count in internal `replica_model_uid` by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/2516
## Bug fixes
* BUG: Compat with ChatTTS 0.2.1 by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2520
* BUG: transformers logs missing by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/2530


**Full Changelog**: https://github.com/xorbitsai/inference/compare/v0.16.2...v0.16.3