v1.6.0

Michael-A-Kuykendall/shimmyv1.6.0Oct 4, 2025by github-actions[bot]

AI Summary

Introduces Windows CUDA support (first in Rust LLM ecosystem) and resolves critical stability issues like concurrent load deadlocks.

Key Highlights

  • First Rust LLM tool with Windows MSVC CUDA support
  • Fixed concurrent load deadlock in ModelManager
  • Added opt-in usage analytics and performance benchmarking tools
  • Implemented professional security policy and DCO compliance

New Features

  • Windows CUDA support
  • Usage analytics
  • Performance benchmarking tools
  • Security policy and DCO compliance

Full Release Notes

## [1.6.0] - 2025-10-04

### 🎯 Windows CUDA Support (First in Rust LLM Ecosystem!)

**Issue #72: GPU Backend Flag Implementation + Windows MSVC CUDA**
- ✅ Fixed `--gpu-backend` CLI flag wiring through to model loading
- ✅ **BREAKTHROUGH**: First lightweight Rust LLM tool with Windows MSVC CUDA support
  - Fixed llama-cpp-rs bindgen header discovery issue blocking Windows CUDA builds
  - Uses cc::Build to extract MSVC INCLUDE paths, passes as -isystem to bindgen
  - Fork: Michael-A-Kuykendall/llama-cpp-rs (branch: fix-windows-msvc-cuda-stdbool)
- ✅ Implemented GpuBackend::from_string() parser with helpful error messages
- ✅ Implemented GpuBackend::detect_best() with priority: CUDA > Vulkan > OpenCL > CPU
- ✅ All 4 GPU backends verified on Windows: Vulkan, OpenCL, CUDA, HuggingFace
- ✅ Binary sizes: 4.8MB (minimal), 24MB (CUDA) + 36MB ggml-cuda.lib
- ✅ Build times: HuggingFace 8s, OpenCL 45s, Vulkan 3m19s, CUDA 11m25s

### 🐛 Critical Stability Fixes

**Concurrent Load Deadlock**
- Fixed RwLock deadlock in ModelManager causing infinite hangs with concurrent tasks
- Pattern: Drop write lock immediately after operations, before calling other functions
- All 295 unit tests now passing (was hanging indefinitely at test_concurrent_load_unload)

**Flaky Property Tests**
- Rebuilt 4 property tests without broken property_test() wrapper
- Fixed test_backend_routing_property, test_generation_length_property, etc.
- Tests now deterministic: 284/284 pass minimal features, 295/295 with backends

**Feature Flag Compatibility**
- Added cfg guards to PPT test modules for llama backend features
- Fixed adapter test compilation with minimal features
- All tests work with `--no-default-features --features huggingface`

### Added
- **Opt-in Usage Analytics**: Anonymous business intelligence collection system
- **Performance Benchmarking Tools**: Cross-platform scripts for real GPU/CPU measurement
- **Comprehensive Security Policy**: Private vulnerability disclosure process (SECURITY.md)
- **DCO (Developer Certificate of Origin)**: Legal compliance for all contributions
- **Professional GitHub Templates**: Issue/PR templates with structured workflows
- **Branch Protection**: Quality gates with CI and DCO enforcement
- **Automated Changelog**: CI/CD integration for release documentation

### Changed
- **Enhanced CONTRIBUTING.md**: Added maintainer process and DCO requirements
- **Improved Documentation**: Comprehensive performance analysis and metrics transparency
- **Professional Repository Structure**: Security-first approach with industry standards

### Security
- **Private Security Disclosure**: GitHub Security Advisories integration
- **DCO Compliance**: All contributions legally certified
- **Branch Protection**: Enforced code review and quality gates

### Documentation
- **Performance Analysis**: Real benchmarking tools and GPU consumption data
- **Metrics Transparency**: Complete disclosure of business intelligence collection
- **Contributing Guidelines**: Clear maintainer process and legal requirements