Starstruk Logo MarkStarstruk

0.1.0

Mailtrain-org/mailtrain0.1.0Jul 23, 2023by 1b5d

AI Summary

The initial release introduces support for Huggingface models and upgraded llama.cpp to run Llama 2. It also streamlines the Docker deployment options into two images.

Key Highlights

  • Introducing Huggingface generic model support
  • Upgrade llama.cpp for Llama 2 compatibility
  • Streamlined Docker images (Default and GPU)

New Features

  • Huggingface generic model support
  • llama.cpp upgrade
  • General fixes and stability improvements

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements