b10098
ggml-org/llama.cppb10098Jul 23, 2026by github-actions[bot]same day as b10094
What changed since b10094
Hexagon backend activation kernels (GEGLU/GLU) are optimized and generalized, with no changes to other backends or CLI behavior.
New features
- Optimized all-in-one GEGLU microkernel for the Hexagon backend.
- Hexagon activation ops now accept non-contiguous source tensors and support strided DMA.
- GLU per-thread functions generalized via a shared DEFINE_GLU_PER_THREAD macro, covering the remaining activation ops.
Improvements
- UNARY_SILU and UNARY_GELU moved into the unary-ops module for better organization.
- Activation ops now compute a local htp_vtcm_layout per op instead of using the generic ops_context scratchpad, improving memory handling.
- Reduced code duplication across GLU variants through macro-based generalization.
Upgrade notes
This release only touches the Hexagon (Qualcomm NPU) backend; CPU, CUDA, Metal, and Vulkan paths are unaffected, so no config or CLI changes are needed. Users on Hexagon hardware should see faster GEGLU/GLU activation and better handling of non-contiguous tensors. The speculative-type inference added in b10094 remains unchanged.
Analyzed Nov 1, 2026
Upgrading?
Release notes summary
Updates Hexagon activation operations with optimized microkernels and improved memory handling for non-contiguous data.
Key Highlights
- Optimized all-in-one GEGLU microkernel
- Enable non-contiguous src and strided DMA
- Generalize GLU per-thread functions
Release Notes (excerpt)
<details open> hexagon: activation ops update (#25974) * hex-geglu: optimized all-in-one geglu microkernel * hex-geglu: enable non-contiguous src and strided DMA * hex-act: enable non-contiguous srs and strided DMA for rest of ACT ops * hex-act: generalize GLU per-thread functions via DEFINE_GLU_PER_THREAD macro * hexagon: move UNARY_SILU and UNARY_GELU to unary-ops * hex-act: replace the generic ops_context scratchpad usage with a local htp_vtcm_layout computation per act op. ---------…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system