v0.1.808-beta 0.9.0
unslothai/unslothSep 9, 2026 → Sep 9, 20260 days between releases
What's New
Reworked connection pool, upstream modules, and security hardening in Pingora 0.9.0
Breaking Changes
- Minimum Rust version moves to 1.85 for some crates (1.88 for pingora-foundations)
- RequestHeader and ResponseHeader no longer implement DerefMut
- Removed async_write_vec APIs
- Prometheus integration moved to separate pingora-prometheus crate
- Upstream requests strip hop-by-hop headers by default
New Features
- Abort-on-close session configurability
- Support HTTP/1.1 downstream request pipelining
- Add cancel-safe body and header writer primitives
- Add TLS offload thread pool configuration
- Add per-peer CA configuration
Improvements
- Reworked connection pooling with sharded storage and global LRU
- Added upstream module system that applies before compression
- Enhanced HTTP parsing and security hardening
- Split Prometheus integration into a separate crate
Bug Fixes
- Fixed descriptor lifecycle issues during shutdown
- Lowered shutdown-notification contention
Upgrade Notes
Update Rust toolchain to version 1.85 or higher. Replace usage of removed async_write_vec APIs with tokio::io::AsyncWriteExt::write_all_buf. Update Prometheus imports to use the new pingora-prometheus crate.
The Two Releases
Large Performance Gains + Fixes
Sep 9, 2026· 1 month ago
This is a large performance and reliability release featuring significant speed improvements for diffusion and inference, especially on AMD and Apple Silicon, alongside over 250 bug fixes and a 60% reduction in binary size.
Full release notesPingora 0.9.0
Sep 9, 2026· 1 month ago
Pingora 0.9.0 introduces a reworked connection pool with sharded storage and a global LRU, an upstream module system, and significant HTTP parsing and security hardening, while splitting Prometheus into a separate crate.
Full release notes