Starstruk Logo MarkStarstruk

0.1.0

simstudioai/sim0.1.0Jul 23, 2023by 1b5d

AI Summary

This initial release introduces support for Hugging Face models and upgrades llama.cpp to run newer models like Llama 2. It streamlines the deployment experience by reducing Docker images to two variants: a lightweight default and a GPU-enabled option. The update also includes general stability improvements and bug fixes.

Key Highlights

  • Introduces Hugging Face generic model support
  • Upgrade llama.cpp to support Llama 2
  • Streamlines Docker images to two variants
  • Includes general fixes and stability improvements

New Features

  • Huggingface generic model support
  • Llama 2 model support

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements