0.1.0
HavocFramework/Havoc0.1.0Jul 23, 2023by 1b5d
AI Summary
This release introduces support for Hugging Face models and Llama 2, alongside a simplification of Docker deployment options.
Key Highlights
- Added generic Hugging Face model support to run popular models
- Upgraded llama.cpp to support newer Llama 2 models
- Streamlined Docker images to two variants: lightweight and GPU-enabled
- Improved general stability and bug fixes
New Features
- Generic Hugging Face model integration
- Llama 2 model support
- Optimized Docker images (lightweight and GPU versions)
Full Release Notes
- Introducing Huggingface generic model, which can be used to run many popular models on HF - Upgrade llama.cpp in order to run newer Llama models like Llama 2 - Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support - General fixes and stability improvements