0.1.0

knadh/listmonk0.1.0Jul 23, 2023by 1b5d

AI Summary

The initial stable release focusing on Docker containerization, generic Hugging Face model support, and upgrades to run newer Llama models.

Key Highlights

  • Introduced generic HuggingFace model support to run many popular models.
  • Upgraded llama.cpp to support newer Llama models like Llama 2.
  • Streamlined Docker images to two variants: a default lightweight one and a GPU-enabled image.
  • General fixes and stability improvements.

New Features

  • Generic HuggingFace model support
  • Llama 2 support via upgraded llama.cpp
  • Streamlined Docker images (lightweight and GPU-enabled)

Full Release Notes

- Introducing Huggingface generic model, which can be used to run many popular models on HF
- Upgrade llama.cpp in order to run newer Llama models like Llama 2
- Streamline docker images down to 2 images: a default lightweight one, and a gpu enabled image with nvidia / cuda support
- General fixes and stability improvements