b10098

ggml-org/llama.cppb10098Jul 23, 2026by github-actions[bot]same day as b10094

What changed since b10094

low risk

Hexagon backend activation kernels (GEGLU/GLU) are optimized and generalized, with no changes to other backends or CLI behavior.

New features

  • Optimized all-in-one GEGLU microkernel for the Hexagon backend.
  • Hexagon activation ops now accept non-contiguous source tensors and support strided DMA.
  • GLU per-thread functions generalized via a shared DEFINE_GLU_PER_THREAD macro, covering the remaining activation ops.

Improvements

  • UNARY_SILU and UNARY_GELU moved into the unary-ops module for better organization.
  • Activation ops now compute a local htp_vtcm_layout per op instead of using the generic ops_context scratchpad, improving memory handling.
  • Reduced code duplication across GLU variants through macro-based generalization.

Upgrade notes

This release only touches the Hexagon (Qualcomm NPU) backend; CPU, CUDA, Metal, and Vulkan paths are unaffected, so no config or CLI changes are needed. Users on Hexagon hardware should see faster GEGLU/GLU activation and better handling of non-contiguous tensors. The speculative-type inference added in b10094 remains unchanged.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Updates Hexagon activation operations with optimized microkernels and improved memory handling for non-contiguous data.

Key Highlights

  • Optimized all-in-one GEGLU microkernel
  • Enable non-contiguous src and strided DMA
  • Generalize GLU per-thread functions

Release Notes (excerpt)

<details open> hexagon: activation ops update (#25974) * hex-geglu: optimized all-in-one geglu microkernel * hex-geglu: enable non-contiguous src and strided DMA * hex-act: enable non-contiguous srs and strided DMA for rest of ACT ops * hex-act: generalize GLU per-thread functions via DEFINE_GLU_PER_THREAD macro * hexagon: move UNARY_SILU and UNARY_GELU to unary-ops * hex-act: replace the generic ops_context scratchpad usage with a local htp_vtcm_layout computation per act op. ---------…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories