Starstruk Logo MarkStarstruk

0.1.0

openmeterio/openmeter0.1.0Jul 23, 2023by 1b5d

AI Summary

This initial release introduces support for Huggingface models and upgrades llama.cpp to support newer models like Llama 2. It also streamlines deployment by reducing Docker images to a lightweight default and a GPU-enabled option, alongside general stability improvements.

Key Highlights

  • Introducing Huggingface generic model for running popular models
  • Upgrading llama.cpp to support Llama 2 and newer models
  • Streamlining Docker images to two variants: default lightweight and GPU-enabled
  • General fixes and stability improvements

New Features

  • Huggingface generic model integration
  • Llama 2 support via llama.cpp upgrade
  • Simplified Docker image deployment options

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements