0.1.1
1b5d/llm-api0.1.1Oct 25, 2023by 1b5d
AI Summary
This release updates core dependencies to support newer model formats, specifically upgrading llama-cpp-python to support the GGUF format and updating GPTQ-related libraries for improved model compatibility.
Key Highlights
- Upgraded llama-cpp-python to support GGUF format
- Upgraded GPTQ-for-LLama related libraries
- Updated README.md
New Features
- GGUF format support in llama-cpp-python
Full Release Notes
- Upgrade llama-cpp-python to support GGUF format - Upgrades to GPTQ-for-LLama related libs - Update README.md