Starstruk Logo MarkStarstruk

0.1.0

GraphiteEditor/Graphite0.1.0Jul 23, 2023by 1b5d

AI Summary

This initial release adds support for HuggingFace models, upgrades llama.cpp to support newer Llama models like Llama 2, and streamlines Docker deployment with two images.

Key Highlights

  • Huggingface generic model support
  • llama.cpp upgraded for Llama 2
  • Streamlined Docker images (default and GPU enabled)

New Features

  • Huggingface generic model
  • llama.cpp upgrade
  • Docker image streamlining

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements