Starstruk Logo MarkStarstruk

0.1.0

joshiayush/inb0.1.0Jul 23, 2023by 1b5d

AI Summary

This initial release introduces a HuggingFace generic model interface, upgrades llama.cpp to support Llama 2, and optimizes deployment by streamlining Docker images into lightweight and GPU-enabled variants.

Key Highlights

  • Introduction of HuggingFace generic model support
  • Upgrade of llama.cpp to run newer Llama 2 models
  • Streamlined Docker images (default lightweight and GPU-enabled)
  • General fixes and stability improvements

New Features

  • HuggingFace generic model integration
  • Llama 2 support via upgraded llama.cpp
  • GPU-enabled Docker image

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements