0.1.1

1b5d/llm-api0.1.1Oct 25, 2023by 1b5d

AI Summary

This release updates core dependencies to support newer model formats, specifically upgrading llama-cpp-python to support the GGUF format and updating GPTQ-related libraries for improved model compatibility.

Key Highlights

  • Upgraded llama-cpp-python to support GGUF format
  • Upgraded GPTQ-for-LLama related libraries
  • Updated README.md

New Features

  • GGUF format support in llama-cpp-python

Full Release Notes

- Upgrade llama-cpp-python to support GGUF format
- Upgrades to GPTQ-for-LLama related libs
- Update README.md