b10004

ggml-org/llama.cppb10004Jul 14, 2026by github-actions[bot]same day as b10003

What changed since b10003

low risk

b10004 adds f16 SET_ROWS support to Vulkan and CPU backends and fixes Intel GPU denormal failures.

New features

  • Vulkan and CPU backends now fully support f16 as the SET_ROWS source, matching existing f32 behavior.
  • Backend test coverage expanded with additional SET_ROWS cases.

Improvements

  • DenormPreserve 16 is enabled when the device supports it, addressing SET_ROWS failures on Intel GPUs.
  • Metal supports_op was updated to reflect the new f16 SET_ROWS capability.
  • Error thresholds for the new backend tests were tuned to reduce flakiness.

Bug fixes

  • Resolves denormalized-number handling failures observed on Intel GPUs during SET_ROWS operations.

Upgrade notes

This is a backend capability addition with no CLI or API changes, so a drop-in binary swap is sufficient. Vulkan users on Intel hardware benefit most, as the denormal fix targets their devices. No config or model migration is required.

Analyzed Oct 31, 2026

Upgrading?

Release notes summary

Added full support for f16 as SET_ROWS source in the Vulkan and CPU backends, improving compatibility and fixing denormalized number handling on Intel GPUs.

Key Highlights

  • Added full support for f16 SET_ROWS in Vulkan and CPU backends.
  • Set DenormPreserve 16 when supported to fix failures on Intel GPUs.
  • Released standard build binaries for multiple platforms.

Release Notes (excerpt)

<details open> vulkan/cpu: Support f16 as SET_ROWS src. (#25432) * vulkan/cpu: Support f16 as SET_ROWS src. This adds full support for f16 SET_ROWS (equivalent to f32) to vulkan and CPU backends, and adds more backend tests. * Set DenormPreserve 16 when supported, to try to fix failures on Intel * tune error threshold * update metal supports_op </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64)…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories