0.1.0
xlmnxp/blue-recorder0.1.0Jul 23, 2023by 1b5d
AI Summary
This release introduces support for HuggingFace models and upgrades llama.cpp to support Llama 2. It also simplifies the deployment by reducing Docker images to a lightweight default and a GPU-enabled option, alongside general stability improvements.
Key Highlights
- Introducing Huggingface generic model
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements
New Features
- Huggingface generic model support
- Llama 2 support
- GPU-enabled Docker image
Full Release Notes
- Introducing Huggingface generic model, which can be used to run many popular models on HF - Upgrade llama.cpp in order to run newer Llama models like Llama 2 - Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support - General fixes and stability improvements