b9965
ggml-org/llama.cppb9965Jul 11, 2026by github-actions[bot]same day as b9964
What changed since b9964
b9965 adds a Hexagon-specific ARGSORT speedup via in-register bitonic sorting; no changes affect other backends.
New features
- Hexagon backend now sorts small tensors (up to 1024 elements) with a bitonic sort implemented directly in HVX registers.
- Specialized sort routines handle the most common ARGSORT shapes/cases on Hexagon.
- Hexagon sort path gains tracing and local-context support for debugging.
Improvements
- ARGSORT throughput for small tensors on Hexagon hardware is improved by keeping sort data in vector registers.
- Corrected inverted vector rotate (vror) instructions in the Hexagon sort implementation.
Bug fixes
- Fixed inverted vrors that would have produced incorrect ordering in the Hexagon sort path.
Upgrade notes
This is a routine build bump with changes confined to the Hexagon backend; CPU, CUDA, Metal, Vulkan, ROCm, SYCL, and OpenVINO users should see no behavioral difference. No config or CLI changes are required, and the previous release's duplicate spec-model download fix remains in place.
Analyzed Oct 31, 2026
Upgrading?
Release notes summary
Enhanced ARGSORT performance for small tensors on Hexagon hardware by implementing efficient bitonic sorting in HVX registers and optimizing common cases.
Key Highlights
- Added efficient bitonic sort in HVX registers (up to 1024 elements)
- Fixed inverted vector rotate instructions (vrors)
- Specialized sort functions for common cases
- Added tracing and local context support
Release Notes (excerpt)
<details open> hexagon: improve ARGSORT performance for small tensors (#25512) * hex-sort: add efficient bitomic sort in hvx regs up to 1024 elements * hex-sort: fix inverted vrors * hex-sort: specialize sort functions for the common cases * hex-sort: add tracing and local context </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU)…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system