v0.8.4

xorbitsai/inferencev0.8.4Feb 4, 2024by XprobeBot

AI Summary

v0.8.4 focuses on bug fixes and documentation updates. It includes UI improvements for long model names and adds GGUF models for llama-2-chat.

Key Highlights

Fixed UI issues with excessively long LLM model names
Added GGUF models for the llama-2-chat series
Fixed custom model tool calls and chat templates
Updated documentation with metric auto-generation and README updates

New Features

Add gguf models of llama-2-chat

Full Release Notes

# What's new in 0.8.4 (2024-02-04)
These are the changes in inference v0.8.4.
## Enhancements
* ENH: [UI] Fix too long LLM model name by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/979
* ENH: Add gguf models of llama-2-chat by @aresnow1 in https://github.com/xorbitsai/inference/pull/981
## Bug fixes
* BUG: Fix custom model tool calls by @codingl2k1 in https://github.com/xorbitsai/inference/pull/978
* BUG: Fix chat template by @aresnow1 in https://github.com/xorbitsai/inference/pull/977
## Documentation
* DOC: Translate model docs by @onesuper in https://github.com/xorbitsai/inference/pull/965
* DOC: Auto gen metrics doc by @codingl2k1 in https://github.com/xorbitsai/inference/pull/967
* DOC: Update README.md by @codingl2k1 in https://github.com/xorbitsai/inference/pull/969


**Full Changelog**: https://github.com/xorbitsai/inference/compare/v0.8.3.1...v0.8.4