Starstruk Logo MarkStarstruk

0.1.0

antgroup/echomimic0.1.0Jul 23, 2023by 1b5d

AI Summary

This initial release introduces support for Hugging Face models and upgrades the underlying llama.cpp library to run newer Llama 2 models. It simplifies deployment by consolidating Docker images into two variants: a lightweight default and a GPU-enabled version. The update also includes general stability improvements and bug fixes.

Key Highlights

  • Introducing Huggingface generic model for running popular models
  • Upgrading llama.cpp to support newer Llama 2 models
  • Streamlining Docker images to a lightweight default and a GPU-enabled variant
  • General stability improvements and fixes

New Features

  • Huggingface generic model integration
  • Llama 2 model support
  • GPU-enabled Docker image

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements