0.0.3-gptq-llama-cuda
1b5d/llm-api0.0.3-gptq-llama-cudaMay 5, 2023by 1b5d
AI Summary
Bug fixes and stability improvements for safetensor models in GPTQ for Llama models.
Key Highlights
- Bug fixes for safetensor models
- Stability improvements for GPTQ
- Support for safetensor model format
New Features
- Safetensor model support in GPTQ for Llama
Full Release Notes
Bug fixes and stability for safetensor models in gptq for llama models