0.1.0

onyx-dot-app/onyx0.1.0Jul 23, 2023by 1b5d

AI Summary

This initial release introduces support for a generic Huggingface model runner and upgrades the underlying llama.cpp library to support newer models like Llama 2. It also streamlines the infrastructure by reducing Docker image dependencies to a lightweight and a GPU-enabled option.

Key Highlights

Generic Huggingface model support
Upgraded llama.cpp for Llama 2 compatibility
Streamlined Docker images (2 images: default and GPU)
General stability improvements

New Features

Huggingface generic model integration
Llama 2 support
GPU-enabled Docker image

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements