0.1.0

HavocFramework/Havoc0.1.0Jul 23, 2023by 1b5d

AI Summary

This release introduces support for Hugging Face models and Llama 2, alongside a simplification of Docker deployment options.

Key Highlights

  • Added generic Hugging Face model support to run popular models
  • Upgraded llama.cpp to support newer Llama 2 models
  • Streamlined Docker images to two variants: lightweight and GPU-enabled
  • Improved general stability and bug fixes

New Features

  • Generic Hugging Face model integration
  • Llama 2 model support
  • Optimized Docker images (lightweight and GPU versions)

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements