Starstruk Logo MarkStarstruk

0.1.0

rowboatlabs/rowboat0.1.0Jul 23, 2023by 1b5d

AI Summary

Introduced generic Huggingface model support, upgraded llama.cpp for newer models, and streamlined Docker images.

Key Highlights

  • Introduced Huggingface generic model support for running popular models
  • Upgraded llama.cpp to support newer Llama models like Llama 2
  • Streamlined Docker images to two variants: a default lightweight one and a GPU-enabled image

New Features

  • HF model support
  • llama.cpp upgrade
  • Docker streamlining

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements