b9774

ggml-org/llama.cppb9774Jun 23, 2026by github-actions[bot]same day as b9773

What changed since b9773

low risk

Vulkan backend gains support for unary operations and non-contiguous memory handling.

New features

  • Added support for unary math operations (SQR, SQRT, SIN, COS, CLAMP, LEAKY_RELU) in Vulkan.
  • Added non-contiguous memory support for NORM operations in Vulkan.
  • Implemented use of unary.comp for SQR/SQRT/SIN/COS/CLAMP/LEAKY_RELU.

Improvements

  • Vulkan backend now supports all backend tests for SQR/SQRT/SIN/COS/CLAMP/LEAKY_RELU/NORM.
  • Improved NORM implementation to handle non-contiguous memory layouts.
  • Fixed supports_op detection for CUDA and WebGPU backends.

Bug fixes

  • Fixed supports_op for CUDA and WebGPU backends.

Upgrade notes

No configuration changes are required. This patch enhances the Vulkan backend with new math operations and fixes detection for CUDA and WebGPU.

Analyzed Oct 17, 2026

Upgrading?

Release notes summary

This release enhances Vulkan backend support by implementing unary operations and non-contiguous memory support for various math functions like SQR, SQRT, and NORM.

Key Highlights

  • Support all backend tests for SQR/SQRT/SIN/COS/CLAMP/LEAKY_RELU/NORM in Vulkan
  • Use unary.comp for SQR/SQRT/SIN/COS/CLAMP/LEAKY_RELU
  • Make NORM support noncontiguous memory
  • Fix supports_op for cuda and webgpu

Release Notes (excerpt)

<details open> vulkan: support all backend tests for SQR/SQRT/SIN/COS/CLAMP/LEAKY_RELU/NORM (#24582) * vulkan: make SQR/SQRT/SIN/COS/CLAMP/LEAKY_RELU use unary.comp * vulkan: make NORM support noncontig * add noncontiguous row test cases for norm/l2_norm, handle this in the CPU backend and l2_norm.comp * fix supports_op for cuda and webgpu </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories