b10051

ggml-org/llama.cppb10051Jul 16, 2026by github-actions[bot]same day as b10050

What changed since b10050

low risk

b10051 corrects KleidiAI kernel dispatch by separating SME(v1) from SME2 hardware capabilities.

Improvements

  • KleidiAI integration now distinguishes SME(v1) and SME2 at both build time and runtime.
  • Kernels are dispatched according to actual hardware support rather than a single combined SME flag.

Bug fixes

  • Fixed incorrect dispatch of SME2-specific kernels on SME(v1)-only ARM hardware.

Upgrade notes

This release only affects builds using the KleidiAI backend on ARM; no config or API changes are required. Rebuild from source if you compile with KleidiAI enabled so the new SME/SME2 detection is baked in. Users on SME(v1)-only hardware should see correct kernel selection after upgrading.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

Updates KleidiAI integration to distinguish between SME (v1) and SME2 hardware capabilities, ensuring correct kernel dispatch.

Key Highlights

  • Added distinction between SME and SME2 in kernel dispatch logic.
  • Kernels are now wired based on actual hardware support for SME(v1) and SME2.
  • Cross-platform binaries included for macOS, Linux, Windows, and Android.

Release Notes (excerpt)

<details open> kleidiai: Add SME vs SME2 distinction in kernel dispatch (#25478) The current integration treats SME as a single capability (CPU_FEATURE_SME) with no distinction between SME(v1) and SME2. The kernels dispatched under CPU_FEATURE_SME use SME2-specific instructions, making dispatch incorrect on SME(v1)-only hardware. We introduce build-time and runtime distinction between SME and SME2, and wire SME(v1) and SME2 kernels based on actual hardware support. </details> **Website:**…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories