b9935

ggml-org/llama.cppb9935Jul 9, 2026by github-actions[bot]same day as b9934

What changed since b9934

low risk

b9935 adds Vision RoPE support to the Hexagon backend, with no changes to other backends or public APIs.

New features

  • Hexagon backend now supports RoPE for vision workloads, enabling on-device vision model inference on Qualcomm DSPs.
  • RoPE on strided half-dim views is supported across all modes in the Hexagon implementation.
  • Hexagon RoPE now accepts non-contiguous destination buffers.

Improvements

  • Source DMA copy size for Hexagon RoPE is decoupled from row stride, allowing tighter transfers.
  • Fixed destination scratchpad pitch handling for non-contiguous RoPE outputs.

Bug fixes

  • Corrected scratchpad pitch computation when the RoPE destination is non-contiguous on Hexagon.

Upgrade notes

This build only touches the Hexagon backend; CPU, CUDA, Metal, Vulkan, and ROCm paths are unchanged, so no config or model migration is needed. Hexagon users running vision models should retest RoPE-dependent paths, since strided and non-contiguous layouts are now handled differently internally.

Analyzed Oct 24, 2026

Upgrading?

Release notes summary

Adds RoPE (Rotary Positional Embedding) support for Vision tasks in the Hexagon backend.

Key Highlights

  • Added VISION RoPE support to Hexagon backend
  • Supported RoPE on strided half-dim views
  • Decoupled DMA copy size from row stride and supported non-contiguous destination buffers

Release Notes (excerpt)

<details open> hexagon: add VISION RoPE support (#25216) * hexagon: add VISION RoPE support * hexagon: support RoPE on strided half-dim views for all modes * hex-rope: decouple src0 DMA copy size from row stride * hex-rope: support non-contiguous dst for RoPE * hex-rope: fix dst spad pitch for non-contiguous dst </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:**…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories