Starstruk Logo MarkStarstruk

0.1.0

deepseek-ai/DeepSeek-Coder-V20.1.0Jul 23, 2023by 1b5d

AI Summary

This release introduces Hugging Face generic model support and upgrades llama.cpp to enable the execution of newer Llama models. Additionally, it streamlines the deployment process by consolidating the Docker images into two distinct versions: a lightweight default and a GPU-enabled option.

Key Highlights

  • Introduction of Hugging Face generic model support
  • Upgrade of llama.cpp for Llama 2 compatibility
  • Streamlined Docker images into two variants (lightweight and GPU-enabled)

New Features

  • Hugging Face generic model integration
  • Llama 2 model support
  • GPU-enabled Docker image
  • Lightweight Docker image
  • General stability improvements

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements